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DESIGN OF TRAINING SYSTEMS 
PHASE II REPORT 



ABSTRACT 



This report consists of three volumes: Volume I presents an 
overview of the activities that comprised the design and 
development effort for the three Design of Training Systems 
computer-based models, a description of the validation process, 
and the long-range implications of the development of an opera- 
tional system of DOTS models. 

Volume II presents a detailed description of the System Capa- 
bilities/Requirements and Resources model, the Educational 
Technology Evaluation model, aiid the Training Process Flow 
model. Model logic design. Input/output parameters, and data 
base conmuni cations are discussed at a level which allows an 
analytical evaluation of each model's design. In addition. 
Level I validation scenarios are presented in sufficient 
detail to allow their duplication if desired. 

Volume III contains the model and data base program descrip- 
tions and operating procedures. Flow charts and program 
listings for the models, interface programs, and the data 
base applications programs are presented in appropriate 
sections. 

The results of Phase II indicate that the selected modeling 
applications are feasible. The models' validation demon- 
strated response to realistic system variable parameters. 
It was concluded that the system of DOTS models is imple- 
mentable and will indeed represent a significant training 
cost savings. 

The DOTS Phase II design and development tasks were performed 
by IBM Corporation for the Training Analysis and Evaluation 
Group, Orlando, Florida (Contract No. N61339-73-C-0097) . 



Reproduction of this publication 
in whole or in part is permitted 
for any purpose of the United 
States Government. 



ERIC 



3 



TAEQ REPORT NO. 12-2 

TABLE OF CONTENTS 
VOLUME II 

SECTION PAGE 
I INTRODUCTION 

PURPOSE M 

ORGANIZATION OF THIS VOLUME I-l 

II SYSTEM CAPABILITIES/REQUIREMENTS AND RESOURCES 

MODEL 

MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS . . . ' II-I 

INPUT PARAMETERS DESCRIPTION 11-10 

OUTPUT PARAMETERS DESCRIPTION ... . 11-13 

MODEL/DATA BASE COMMUNICATION ' 11-21 

LOGIC DESIGN 11-24 

LEVEL 1 VALIDATION SCENARIOS 11-30 

III EDUCATIONAL TECHNOLOGY EVALUATION MODEL 

MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS . . . III-l 

INPUT PARAMETERS DESCRIPTION 111-4 

OUTPUT PARAMETERS DESCRIPTION III-ll 

LOGIC DESIGN IIM4 

LEVEL 1 VALIDATION SCENARIOS III-19 

LEVEL 1 VALIDATION RESULTS II 1-31 

IV TRAiraN<^ PROCESS FLOW MODEL 

MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS . . . IV-1 

INPUT PARAMETERS DESCRIPTION IV-4 

OUTPUT PARAMETERS DESCRIPTION. IV- 16 



ERIC 



1 

4 



TAEG REPORT NO. 12-2 

SECTION PAGE 

MODEL/DATA BASE COMMUNICATION IV- 17 

LOGIC DESIGN IV- 18 

LEVEL 1 VALIDATION SCENARIOS IV-22 

V MODEL TEST APPLICATIONS SCENARIOS 

CONDITIONS FOR MODEL APPLICATION V-1 

PROBABLE APPLICATIONS OF THE DOTS MODELS V-1 . 

% 



4 
I 

I 

ii 

o 5 

ERIC 



TAEG REPORT NO. 12-2 



LIST OF FIGURES 

FIGURE NO. TITLE PAGE 

II-l SCRR Model Functional Flow II -2 

n-2 Requirements Specification Listing 11-14 

n-3 LP Optimal Solution and Sensitivity 

Analysis - Resource Data .... II-16A 

n-4 LP Optimal Solution and Sensitivity 

Analysis - Course Data II -IS 

II-S Resource Requirement Matrix 11-22 

1 1-6 Data Base Listing - Course 536K 11-23 

II-7 Instructor File Listing 11-23 

II-8 Data Base Listing - Course 510G 11-25 

II-9 Data Base Listing - Course 5696 .11-25 

11-10 Scenario 1 - Requirements Specification 

Listing Excerpt 11-32 

II-ll Data Base Listing - Course 007E 11-33 

n-12 Data Base Listing - Course 347U . . . . . . II-33 

11-13 Scenario 1 - Requirements Specification 

Listing Excerpt . 11-34 

11-14 Formatted MPSX Input Excerpt 11-35 

I I -IS Scenario 1 - SCRR Resource Data Output 

Excerpt 11-37 

11-16 Scenario 1 - SCRR Course Data Output 

Excerpt 11-39 

11-17 Instructor File Load/Change Card Format .... 11-41 

11-18 Scenario 2 - Requirements Specification 

Listing Excerpt 11-41 

11-19 Scenario 2 - SCRR Resource Data Output 

Excerpt 11-43 

11-20 Scenario 2 - SCRR Course Data Output 

Excerpt 11-44 



iii 



TAEG REPORT NO. 12-2 

FIGURE NO. TITlE PAGE 

n-21 Scenario 3 - Requirements Specification 

List - IT/AD School n-45 

11-22 Scenario 3 - SCRR Resource Data Output - 

IT/ AD School n-46 

11-23 Scenario 3 - SCRR Course Data Output - 

IT/AD School 

11-24 Data Base Listing - Course 3400 11-48 

11-25 Data Base Listing - Course 3691 11-48 

11-26 Scenario 3 - Requirements Specification 

Listing - Final Results 11-51 ^ 

11-27 Scenario 3 - SCRR Resource D&ta Output - 

Final Results * 11-52 

11-28 Scenario 3 - SCRR Course Data Output 

Final Results 11-53 

11-29 Scenario 4 - Requirements Specification 

Listing - 700 Hours Availability 11-54 

11-30 Scenario 4 - SCRR Resource Data Output - 

700 Hours Availability . 11-55 

11-31 Scenario 4 - SCRR Resource Data Output - 

900 Hours Availability 11-55 

11-32 Scenario 4 - SCRR Resource Data Output - 

1000 Hours Availability 11-56 • 

11-33 Scenario 4 - 5CRR Resource Data Output - 

1200 Hours Availability 11-57 

11-34 Scenario 4 - SCRR Course Data Output - 

700 Hours Availability 11-58 

11-35 Scenario 4 - SCRR Course Data Output - 

900 Hours Availability 11-58 

II- 36 Scenario 4 - SCRR Course Data Output - 

1000 Hours Availability 11-59 

n.37 Scenario 4 - SCRR Course Data Output - 

1200 Hours Availability 11-59 

III- l Educational Technology Model Macro Logic • • • ^^"^ 



ERIC 



iv 

7 



TAEG REPORT NO. 12-2 



FIGURE NO . TITLE PAGE 

I I 1-2 Input Card Specifications 111-6 

111-3 Standard GPSS Output 111-12 

III-4 Alternate Output Format III-15 

1 1 1-5 Assumed Distribution of Instructor 

Assistance Times . , . III-20 

1 1 1-6 Trace Sample Output 1 1 1-22 

III- 7 EW School Simulation Input . . III-27 

I'M TPF System Integrated Flow IV-3 

IV- 2 Sample TPF Format IV-5 

IV-3 Sample No-Show Summary Printout IV-11 

IV-4 Sample TPF Data Collection Program Format . . . IV-13 

IV-I> Course Release Scheduler IV- 15 

IV-6 TPF School and Center Formats IV-23 

IV-7 Scenario - Excessive No-Show Rates - 

Reduction of No-Shows to Achieve Through- 
put Rates IV-26 

IV-8 Scenario - Excessive No-Show Rates - 

Increase Convenings to Achieve Through- 
put Rates IV-27 

IV-9 Scenario - Variation In Student Characteristics - 

Calculate Failure Rates for Revised GCT and 
ARI Averages IV-28 

IV-IO Scenario - Variation In Student Characteristics - 

Course Throughput Using Revised Failure 
Rates IV-29 

IV-U Scenario - Backlog Reductlon-Temporarily 

Increase Convenings to Work off Backlog . . . IV-30 

IV- 12 Scenario - Align Capacity to Demand- Reduce 

Convet 1ng Frequency to Improve Utilization 

Percentage IV- 31 

V- 1 T'^alning System Responses to General 

Demands V-2 

V 

ERIC ^ 



TAEG REPORT NO. 12-2 



FIGURE NO,. TITLE PAGE 

V-2 DOTS Model Applicability Under Different 

Types of Demand V-3 

V-3 Application of Models to Existing System .... V-5 

V-4 Model Application to ILS Implementation .... V-6 

V-5 Model Application to Introduction of New 

. Equipment . . . V-7 

V-6 Model Application for Change to System 

Structure V-10 



ERIC 



vl 



TAEG REPORT NO. 12-2 



LIST OF TABLES 

TAULL NO. HlkL PAGk 

IH-1 Module Type Code Definitions HI-S 

III-2 Variability Test Results 111-24 

III-3 Comparison of ETE Model vs. Special 

Purpose Model 1 1 1- 30 

V-l Implications of Proposed Changes in 

Training Occurrences ... V-9 



ERIC 



vii 



10 



TAEG REPORT NO. 12-2 



(THIS PAGE INTENTIONALLY LEFT BLANK) 



V111 

11 



TAEG REPORT NO. 12-2 



SECTION I 



INTRODUCTION 



PURPOSE 

Volume II presents a detailed description of the DOTS systein. The 
term system is used because the models and the data base form an interacting 
and interdependent group of functional training management tools. It is the 
intent of Volume II to give the analyst sufficient Information to allow a 
thorough understanding of the three DOTS models, to delineate the data re- 
quirements and data base communication, and to explain the logic design and 
the validation of that design during Phase II. 

ORGANIZATION OF THIS VOLUME 

Volume II is organized into sections for each model in the nOTS system-, 
i.e., the Sys;:em Capabilities/Requirements and Resources model, the Educa- 
tional Technolooy Evaluation model, and the Training Process Flow model. 
Each model section follows the same format to allow the reader to make 
comparisons of similar aspects among the three models. Phase II validation 
scenarios are presented as an Integral part of each model discussion. The 
proposed Phase III scenarios are presented separately. 
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SECTION II 

SYSTEM CAPABILITIES/REQUIREMENTS AND RESOURCES MODEL 
MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS 

FUNCTIONAL SPECIFICATIONS. The objective of the System Capabilities/Require- 
ments and Resources (SCRR) model Is to provide Navy training complex officials 
with sufficient physical resource Information (1.e.» courses. Instructors, 
classrooms, laboratories) and related analyses to: 

a. Assess the feasibility of meeting annual training requirements at the 
training complex level. 

b. Evaluate alternative plans for meeting both short and long-term train- 
Ing requirements. 

c. Assess the utilization of existing resources In the dally operation of 
the training complex. 

The SCRR model will perform the data analyses required to fulfill these objectives 
through the solution and subsequent sensitivity analysis of the following linear 
programming problem. 

• Determine the maximum student throughput based on an optimal mix of 
course convenlngs which a training complex can achieve In a r«pec1f1ed 
period of time, subject to either existing or projected physical re- 
source constraints. 

Specifically, a training complex official will be able to use the SCRR model to 
■analyze the projected Impact of modifications to training demand or resource 
availability on student throughput, course convenlngs, and resource utilization. 
The following are presented as examples of modifications which the SCRR model 
will evaluate. 

a. Courses can be added to or deleted from the training complex schedule. 

b. Course lengths can be increased or decreased. 

c. Course convening frequencies can be altered. 

d. Normal course capacities can be increased or decreased. 

e. Student/ instructor ratios can be modified. 

f. Instructors can be added or deleted. 

g. Instructor qualifications can be modified. 

h. Instructor availability can be increased or decreased. 

i. Classroom and laboratory availabilities can be Increased or decreased. 
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In addition to optimizing student throughput, the SCRR model can also be used 
to calculate the quantity and mix of resouv-ces required to achieve a user- 
specified student throughput. The model user can specify student throughput 
by establishing the model parameter for number of course convemngs as a fixed 
value equal to the current number of convenings. 

The SCRR model can be run for an individual school (when teaching assignments 
do not cross school lines), for groups of schools, or for the total training 
complex. 

SCRR MODEL DESCRIPTION. Figure II-l depicts the SCRR model functional flow. 
The components of the functional flow can be divided into three distinct 
categories: 

a. Data Base 

b. SCRR Model 

c. User Analysis. 

The SCRR model will accept input data from two sources - the DOTS data base and 
the SCRR data base. The SCRR data base is a temporary copy of the DOTS data 
base which the model user can alter to represent projected training require- 
ment/resource relationships, or to answer "what if" questions without destroying 
the data stored In the DOTS data base. Although the data base is not an 
Integral part of the SCRR model, model operation is dependent upon the data base. 

The four primary components of the SCRR model are: 

a. Formulate LP objective function and constraint equations. 

b. Compute linear programming solution. 

c. Perform post-optimal sensitivity analysis. 

d. Format optimal solution and sensitivity analysis output. 

The remaining functional flow components fall into the user analysis category. 
The user must analyze the optimal solution and the sensitivity analyses results 
to determine If that solution can be implemented. If not. then he must con- 
sider the previous results together with infonnation from other sources, in- 
c uding data from the Training Process Flow (TPF) and the Educational Technology 
Evaluation (ETE) models, to modify the resource mix, training requirements, or 
other model parameters. 

ni>^ <an of Training Systems (DOTS) Data Base . The DOTS data base provides a 
sing l e data source for the jCkft model and Tigniflcantly reduces the amount of 
data tharmust be entered each time the mde} is run. All input^data required 
by the SCRR model, such as course data (length, capacity, convening frequency. 
Instructor, classroom, lab. and equipment requirements). Instructor data 
(qualifications, assignments, availability, rotation date), and classroom and 
laboratory data (location, capacity, availability, course assignments) are stored 
in the DOTS data base. The data base will be updated monthly to ensure that it 
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?nfl ^Jmn?or J^r^l^'^^ requirements and the resources available to the train- 
In?iSc?? i' ^^^sjjssign feature enables the SCRR model user to obtain an 
analysis of current resources as applied to current training reauirements thp 

rprrclnta\"l^^?'LL"?^^ classroom, and UbiJa^o'rr^Jniz^l^ 

cou^n wh?rh ?c Jf*^ """I'^er of convenings of each 

course which is feasible at the current resource level, and resource trade-offs 
for resources which are applied across two or more courses t'^ade-offs 

Irlo^l^l appropriate data base elements (utilizing the temporary 

aS^n^?ic,-c'fn^ *° initiating the LP problem fomulation module to ob?Ii^ 

tLiDo^IrS ?ri}R^ c specified data base (either DOTS or 

f^En^fJ^nn i ^ directly accessed by the LP problem formulation module. The 

• eleme ts ?o Trtitl ZX Z'^l'^'H ^'"^^^'^^^ and refomaitfng 

be S^rL;L tfjL ?• o»>Jectiye function and all constraint equations to 
oe processed by the linear programming module. 

v/of*{hl^ep"t!^ °^ ''^'^ ^'^^ ^" 

Modify DOTS, Data Base to Represent Alternative S y stem to be Analyzed (SCRR D ata 
Isf^'iv^rinf rnn!fn5c"li''i'? J^^J i^P^t to the linear programming module were 
tS aSSTJIls o?"Jh2 ?n?L!5f4^'*S^''?' 5P ""^^"^ application would be restricted 
fn Ihl Alll flA^ interaction Of only those resources and requirements described 
m^Aifl ^lll till' ^° ^'^^J^^cJRS °^ application of the rSodel, the optional 
bScl L^nu base component SCRR data base) has been Inserted between the data 
lJ FlSS?e Il-h ^ fonnulation module in the functional flow depicted 

Training complex officials have the option of proceeding directly from the DOTS 
^nl* base component to the LP problem formulation module, thus generating an 
p^iEilitf describes the utilization and Interactions if current resourd 
elements. However, the training official may elect to modify some or all of the 
h? ^ase. to detrrSinrthe felsi- 

Morf JirJHnnfSS^JS^ niodification to training demand or resource availability. 
Modifications to the data base might be made to: 

a. Incorporate data from either the TPf or the ETE models. 

b. Incorporate results of previous SCRR model runs. 

^' rnSllL llSi!^* questions posed by training complex officials, 
COMTRALANT, or CNET. 

.u!j"^!l?L^jl°'^j^Sj''^ Function and Constraint Fgn.t^nnc Linear programming 
deals with tne proDiems arising out of the need to allocate limited resource 
among competing activities to meet desired objectives. These problems are 
characterized by the large number of solutions that satisfy the basic conditions 
of each problem. The selection of a particular solution as the best solution 
to a problem depends on some aim or overall objective that Is implied In the 
statement of the problem. A solution that satisfies both the conditions of 
iaJhSISj !Ti*?f * ® given objective Is termed an optimum solution. The complete 
mathemat cal statement of a linear programming problem includes a set of simul- 
taneous linear equations or inequalities which represent the conditions of the 
problem, and a linear function which expresses the objective of the problem. 
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The linear prograraming term "objective function" represents the target of the 
linear prograinming solution. The answer to the problem must satisfy this re- 
quirement. The objective function must be clearly stated and expressed as a 
linear mathematical function. The stated objective of the SCRR linear pro- 
gramming model is to maximize the student throughput which a school or train- 
ing complex can achieve in a specified time period subject to existing physical 
resource constraints. This objective can be expressed mathematically as: 



J 

MAXIMIZE z C.X, 
J j 

j«l 

which is shorthand notation for saying 

"MAXIMIZE CiXi + C2X2 + C3X3 + ... + CjXj". 

Where 

Xj s number of annual convenings of course j. 

Cj » normal capacity of students in course j based upon both training 
considerations and physical considerations. 

The LP problem formulation module constructs the objective function based on 
the normal course capacities and reformats the function to satisfy the input 
requirements of the LP module. 

Several conditions or restraints must be considered in the formulation of the 
SCRR linear progranming problem. 

Course syllabi require a specific amount of classroom instruction time from one 
or more instructors for each course convening. However, only a limited group 
of instructors is qualified to teach each course. Therefore, the total amount 
of time the group of instructors has available for classroom Instruction limits 
the number of times the course can be convened. The product of the classroom 
Instruction time and the number of convenings cannot exceed the total amount of 
time each group of instructors has available. 

Each course syllabus also requires that classroom and/or laboratory space be 
available for each convening. The amount of time each facility is available 
also represents a limitation to the number of times a course can be convened. 
In addition to the constraints imposed by instructors, classrooms, and labo- 
ratories, most courses are further restricted in that they must be convened 
some minimum number of times to fulfill a minimum training requirement to train 
a minimum number of individuals. 

These conditions can be mathematically stated as a set of simultaneous inequal- 
ities as follows: 

(1) J 

I a^j Xj i TCH^ i « 1, 2, ... I. 
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(3) 



Where 



Where 



TAEG REPORT NO. 12-2 



a^j » number of Instructor contact hours required by course 
syllabus for the 1**^ group/category of instructors for 
one convening of course j. 

TCHj a total contact hours available per year for the i^*^ 
group/category of instructors. 



J 

j « 1 



Xj. s TLA,, 



k « 1, 2, 



K. 



by a nwnber of hours of usage required from laboratory type k 
^ for each convening of course j. 

TLA|( > total hours per year which laboratory type k is available 
for use. 



2 <^Ttd s CRAj^ ra = U 2, 



M. 



j « 1 



d|^j - number of hours of usage required from the type m classroom 
for one convening of course j. 

CRA„ a total hours per year the type m classroom is available for 
use. 



(4) Xj > MINj. 



MINj » minimum number of convenlngs per year for course j to meet 
a minimum training requirement. 



The formulation module constructs the entire set of simultaneous inequalities 
described above, and reformats the constraints to confom to the Input require 
ments of the LP module. The user must supply values for two program control 
parameters to initiate the LP formulation module: (1) Dept. - specify the 
name of one or more organizational departments (i.e., ASW, SUPPLY, TTM, etc.). 
If no departments are listed, all training center departments will be included 
In the model run; and (2) Objective - specify either "LO" to determine the 
maximum student throughput and maximum convenlngs for ^acH course possible 
with the specified resources, or "FX" to determine the resources required 
to achieve a specified throughput or nunber of course convenlngs. 
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Compute Linear Programming Solution . The linear programming module accepts 
.?ormatted Input from the LP problem' formulation module and calculates either 
the maximum student throughput and maximum convenings of each course possible 
per year subject to the expressed physical resource constraints, or the 
quantity of resources required to attain a specified throughput or convening 
schedule. Since many excellent te^jtts which provide detailed methodology for 
linear programming computational procedures are available, these procedures 
and associated mathematical proofs will not be included in this report. Several 
of these books are listed in the bibliography (Volume III, Section VI). A more 
extensive linear programming bibliography (nearly 500 books and articles) can 
be found in Dantzig's Linear Programming and Extensions '. 

An IBM program product. Mathematical Programming System Extended (MPSX)^, is 
utilized to perform the linear programming computations. The MPSX linear 
programming procedures use the bounded variable/product form of the inverse/ 
revised simplex method. 

Perform Post-Optimal Sensitivity Analysis . The purpose of the sensitivity 
analysis module Is to provide information concerning the range of operations 
In the neighborhood of the optimum solution as calculated by the LP module. 
The sensitivity analysis will provide information relative to how changing 
instructor, classroom, or laboratory utilization effects the optimal student 
throughput, and the range of instructor, classroom, and laboratory utilization 
hours for which the solution, as originally stated, remains optimal. The sensi- 
tivity analysis will also generate information describing the effect of class 
size on the optimal solution as well as the feasible range of annual convenings, 
and t^e effect of changing the number of convenings on the optimal student 
throughput. The information obtained from the sensitivity analysis should 
prove to be as valuable as the specification of the optimum solution itself. 

There are several reasons for performing a sensitivity analysis. Stability of 
the optimal solution under changes of parameters may be critical. For example, 
using the old optimum solution point, a slight variation in the required number 
of convenings or in instructor requirements may result in a large unfavorable 
difference in the objective function (student throughput), while a large 
variation in either of the parameters in another direction may result in only 
a small difference. The training center official may find it desirable to 
move away from the optimum solution when variables such as course demand, which 
are not considered in the SCRR model, are taken into account. 

Instructor, classroom, laboratory requirements and availabilities, minimum con- 
vening frequencies, and class capacities are to some extent controllable and it 
would be advantageous to know the effects which would result from changing the 
values of these parameters. Determination of the range of values for each of 
the parameters for which the solution remains optimum will also identify those 
parameters to which the optimum solution is extremely sensitive. 



Linear Programning and Extensions , by G. B. Dantzig (Princeton University 
Pr^ss, Princeton, N.J., 1963}. 

MPSX Linear and Separable Programming Program Description Manual (SH20-096 8-1) , 
(IBM Corporation, Revised August 30, 1973). 
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a. Recjuirements Specification Listing 

b. LP Optimum Solution and Sensitivity Analysis - Resource Data 

c. LP Optimal Solution and Sensitivity Analysis - Course Data. 

The requirements specification listing will list, by name, the individual momhorc 

elch'i s ?uc\'o?^%'or^^ I'J Ta'' ?y?^l«^^l^-ty oftdi^id5al"tt?^ 
fl^nl r^r^S'^u*'^^^ courses instructed by the instructor 

LTreJ reSe t'^o^^Lt'°in^'lu^"^Sr ^''^ instructor grou^ Thrcontac? 
annual JoiSnL rni fL^"***^"?^^ convening, the current number of 

ThHisHnfl u y?^:!^""* capacity will be noted for each course. 

by course number, all courses which utilize each 
ioM^i^u? I'if laboratory facility! The nuniber of hou^ pe? con- 

vening will be listed by course for each of the classrooms and iSs. 

oStSSrS^i ?hI"«Sc^?•^J®"''**^^'*^y '^"S^?^^^ - f^^^ource Data. The LP module 
Tnail nM?„^5%!®"*!*i''^^,?"*^y*^^ °"*P"^ f^ave been combined into a 

hi resource data. Instructor resources are identified 

h^J3fr"f*S' ^'^"P number. Classrooms and laboratories are identified by 
for eiSh ?2sou'?S:""'"^''* the following 

a. Annual availability. 

b. Annual utilization. 

c. Hours per year not utilized. 

d. Percent utilization. 

e. Upper and lower limits of resource utilization hours. 

f. Student throughput change per unit resource change. 

g. Identification of variable which limits utilization range, and whose 
value will change as the resource level Is modified. 

LP Optimal Solution and Sensitivity Analysis - Course Data. As with the' resourco ' 
nJlJinSS ^'^^ l^l jodule^nd the sensitiviiy analysis modufl is 

CDP SSihll" J for course data. Courses are'^i den ti fled by 

CDP numbers. The course data section lists the following for each course: 

a. Maximum number of annual convenlngs. 
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b. Current number of scheduled convenlngs. 

c. Normal course capecity. 

d. Range of annual conv*»nings. 

e. Student throughput change per course convening change. 

f. Range of course capacities to which Indicated solution can be applied. 

g. Identification of variable which limits convenlngs range, and whose 
value will change as the convening level Is modified. 

Can Indicated Solution be Implemente d? After the training complex official has 
analyzed the linear programming optimal solution and the output from the sensi- 
tivity analysis, he is finally in a position to Interpret and evaluate the 
model results. To successfully Interpret the model results, the official must 
be familiar with the mathematical formulation of the linear prograiming problem. 
The objective of this familiarization requirement is not to understand the 
internal mathematical manipulations required to achieve the linear programming 
solution, but to be aware of simplifications and deviations from reality that 
were, of necessity, built into the initial linear progranming formulations. 
Model results must be Interpreted taking all assumptions and simplifications 
into full consideration. 

Assuming that the official either accepts the model results or modifies the 
model output, based on his experience and intuitive feeling for the situation 
being analyzed, his next task is to evaluate the results in terms of Implementa- 
tion feasibility. If, because of some physical, monetary, political re- 
striction, full or partial Implementation is not feasible, the problem state- 
ment must be reformulated utilizing any new data or insights resulting from the 
Initial problem solution and sensitivity analysis. 

Reformulate Training Resource Problem Incorporating Sensitivity Analysis Results . 
The problem refomuiation module, together with the DOTS data base and data from 
the TPF and ETE models, feeds the data modification module (see Figure II-l). The 
refonnulatlon component completes the iterative cycle. Based on SCRR model re- 
sults, experience., and intuition, an official has the ability to modify initial 
problem statements or to develop new potential alternative solutions to be 
evaluated. At this point, the official need only remodify the DOTS data base 
to Initiate an additional cycle of the iterative process. 

Data From Training Process Flow and Education Technology Evaluation Models . 
The results of the TPF and the ETE models may suggest modifications to several 
of the SCRR model variables; e.g.: 

a. Several courses should be individualized, reducing Instructor require- 
ments and calling for modifications to classroom and laboratory space 
requirements. 

b. Student/instructor ratios should be increased for the lab sessions in 
several courses to reduce failure rates. 
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c. Convening frequencies should be increased to reduce the wait time 
required to attend several courses. 

d. Convening frequencies should be reduced for low utilization courses. 

The DOTS data base can be modified, using the temporary SCRR data base, to 
reflect changes such as those listed, prior to initiating the SCRR model. 

INPUT PARAMETERS DESCRIPTION 

SCRR model input parameters contained in the DOTS data base are described 
below. 

COURSE DESCRIPTION (TEN POSITION CHARACTER FIELD - FORMAT » X-XXX-XXXX). Courses 
are identified by a seven or eight position alphanumeric designator. A prefix 
letter Identifies the activity holding curriculum/eligibility control of the 
course J i.e., "A" for Bureau of Naval Personnel, "J" for Training Conmand, 
Atlantic, and "K" for Training Coimand, Pacific. A middle grouping will consist 
of a number and a letter or a three digit number. The number and letter In- 
dicate an officer skill. The three digit nuiriber indicates an enlisted course. 
A final grouping Is made up of four digits which Indicate the course sequence 
nuirber. 

CDP NUMBER (FOUR POSITION CHARACTER FIELD - FORMAT « XXXX). The CDP number is 
a four digit alphanumeric number used by NITRAS as a course identifier. Each 
course is assigned a unique CDP number. All data elements contained In the 
training resource data base are keyed to the COP number. 

COURSE LENGTH (THREE POSITION NUMERIC FIELD - FORMAT = XX. X). Course lengths 
are stored In weeks. One-half day is equivalent to 0.1 week. 

CUSS INPUT CAPACITY (THREE POSITION NUMERIC FIELD - FORMAT ■ XXX). The planned 
maximum number of students that can attend any one convening of the course. 
Capacities are based upon training considerations such as instructor to student 
ratio, availability of training equipment, workshop, laboratories, and mock-up 
facilities, as well as physical considerations such as classroom sl7.e. 

NUMBER OF CONVENINSS PER YEAR (THREE POSITION NUMERIC FIELD - FORMAT = XXX). 
The number of times each course Is scheduled to convene over the next twelve 
months. Course schedules are based on course capacities and projected train- 
ing requirements. 

STUDENT/INSTRUCTOR RATIO (THREE POSITION NUMERIC FIELD - FORMAT = XX.X). A 
numerical index describing the number of trainees per instructor. 

CONTACT HOURS (FIVE POSITION NUMERIC FIELD - FORMAT « XXXX.X). The number of 
Instructional contact hours taught at a given ratio of trainees per instructor. 
A contact hour represents sixty minutes of Instruction. This refers to clock 
hours of curriculum time devoted to actual Instruction, exclusive of breaks, 
administrative time, lunch, medical, dental, etc. 

NUMBER OF INSTRUCTORS (THREE POSITION NUMERIC FIELD - FORMAT » XXX). The 
nwnber of Instructors required to conduct the class for the Indicated number 
of InstHictlonal contact hours. The number of Instructors Is determined by 
dividing the class capacity by the student/Instructor ratio. 
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CONTACT HOUR TYPE (ONE POSITION CHARACTER FIELD - FORMAT = X). Contact hours 
are classified as either theory/classroom hours or laboratory hours. Theory 
hours refer to those hours spent in the presentation of subject matter 
primarily utilizing discussion, lecture, demonstration, or programmed instruc- 
tion methods of presentation. Laboratory hours include those instructional 
hours Involving actual or simulated Job experience. In addition to laboratory, 
this Includes shop, line, and field instruction. 

INSTRUCTOR NUMBER (THREE POSITION NUMERIC FIELD - FORMAT = XXX). An identifica- 
tion number assigned to each instructor to simplify data manipulation. 

CURRENT ASSIGNMENT (ONE POSITION CHARACTER FIELD - FORMAT « X). Denotes that 
an Instructor is currently assigned to a particular course. An instructor may 
be assigned to more than one course in situations where course lengths are less 
than convening frequency. Thus, an Instructor assigned to a one week course 
which is convened the first week of every month, could also be assigned to 
another one week course which Is convened the third week of every month. 

INSTRUCTOR AVAILABILIT7 (FOUR POSITION NUMERIC FIELD - FORMAT = XXXX). The 
number of hours per year an instructor has available for classroom instruction. 
The following activities are excluded from the contact hour availability figure: 
supervisory requirements; military duties; preparation for instruction; duties 
related to Instruction; annual leave; illness; special training; and break-in 
time. 

RELATED COURSE NUMBER (FOUR POSITION CHARACTER FIELD - FORMAT » XXXX). 
Identifies an additional course(s) which Is also Instructed by the same in- 
structor group. An instructor group is comprised of one or more Instructors, 
all of whom teach the same course or group of courses. The related course in- 
formation is included in the data base to facilitate the formulation of the 
linear programming constraint equations. 

INSTRUCTOR GROUP (THREE POSITION NUMERIC FIELD - FORMAT = XXX). The instructor 
group designator is used to subdivide total course instructor requirements be- 
tween two or more instructors or groups of instructors. For example, a one 
week course is comprised of four days of classroom lecture and discussion with 
an Instructor requirement of one, and one day of laboratory work with a require- 
ment for two instructors. The total contact hour requirement for this course 
would be 36 hours [4 days x 6 hrs/day x 1 instructor] + [1 day x 6 hrs/da^y x 
2 instructors]. Instructor A teaches both classroom and laboratory sections of 
the course and, therefore, is associated with thirty of the thirty-six required 
contact hours. The remaining six hours are associated with instructor B who 
assists with the lab portion of the course. The instructor group designator is 
used to subdivide the total thirty-six hour requirement between the two in- 
structors. Instructor group one is assigned to Instructor A and instructor 
group two is assigned to Instructor B. All instructors are assigned an in- 
structor group number. Each instructor can be a member of only one instructor 
group. The group number is used to relate specific Instructors or groups of 
instructors to specific Instructional requirements and to specified related 
courses. Assuming instructor A also teaches course X and instructor B also 
teaches course Y, both X and Y would be noted as related courses, course X 
through instructor group one and course Y through Instructor group two. As 
with the related course number element, this data element is also included 
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primarily to facilitate constraint equation formulation within the computa- 
tion module. 

CLASSROOM (EIGHT POSITION CHARACTER FIELD - FORMAT = XXXXXCBLDG]XXX[RM3) .. 
Classroom and laboratories are identified by both building and room number. 

ROOM TYPE (ONE POSITION CHARACTER FIELD - FORMAT - X). Room type is used to 
further describe the available spaces. Type has been divided into three cate- 
gories: (1) laboratory usage onlv - permanently installed equipment (includes 
training devices, simulators); (2) lecture usage onlyj and (3) both classroom 
and laboratory. 

ROOM CAPACITY (THREE POSITION NUMERIC FIELD - FORMAT = XXX). The capacity 
represents the number of students that can be effectively instructed in the 
identified space. Room capacities are a function of the number of equipments 
Installed in the space and/or the number of desks or chairs which can be posi- 
tioned in the space. The equipment variable Is Incorporated into the descrip- 
tion of the classrooms and laboratories, and equipment constraints are Included, 
by definition, in room capacities. 

REQUIRED HOURS (FIVE POSITION NUMERIC FIELD - FORMAT « XXXX.X). Required 
hours represent the number of hours the indicated space Is required to convene 
one session of the referenced course. 

AVAILABLE HOURS (FIVE POSITION NUMERIC FIELD - FORMAT « XXXXX). The number of 
hours, on an annual basis, the space Is available for instructional purposes. 

DATA ELEMENT SOURCE. Data elements in the DOTS data base which are utilized 
by the SCRR model are derived from two primary sources. The following data 
elements can be obtained from CNTECHTRA Instructor Computation form 5311-1. 



a. 


Course Identification 


b. 


Course Length 


c. 


Class Input Capacity 


d. 


Convenlngs Per Year 


e. 


Student/ Instructor Ratio 


f. 


Contact Hours 


9' 


Number of Instructors 


h. 


Contact Hour Type. 



A completed CNTECHTRA form 5311-1 for each course of instruction at FLETRACEN 
NORVA Is on file with the center's Director of Training. The remaining data 
Items, while not systematically maintained and not available from a single 
point of contact at the training center, are available from each of the 
center's eleven school directors. Training center officials will be respon- 
sible for the accuracy of the data base contents. 



ERIC 



11-12 

25 



TAEG REPORT NO. 12-2 



OUTPUT PARAMETERS DESCRIPTION 

The SCRR model utilizes a linear programming technique to optimize student 
throughput, subject to limitations of resources required to convene training 
courses. One of the model output parameters, number of course convenings, pro- 
vides the basis for the student throughput calculation for each model run. Class 
capacity is also a factor in the throughput calculation, but capacity remains 
constant for each model run. The levels of resources required to achieve the 
optimal student throughput are the only other model output parameters. One 
section of moc*el output dealing with the LP optimal solution and the sensitivity 
analysis results is devoted to each type of parameter. The Requirements Speci- 
fication Listing provides the model user with a cross-tabulation of courses and 
resource requirements. The Requirements Specification Listing Is created by the 
LP problem formulation module. The objective of the listing 1s to correlate the 
DOTS data base input with the LP Optimal Solution and Sensitivity Analysis output. 
The two types of model output parameters will be described by an explanation of 
the three SCRR model output listings: 

a. Requirements Specification Listing 

b. LP Optimal Solution and Sensitivity Analysis - Resource Data 

c. LP Optimal Solution and Sensitivity Analysis - Course Data. 

REQUIREMENTS SPECIFICATION LISTING. A sample printout of the Requirements 
Specification Listing is presented in Figure II-2. The listing correlates the 
training resources - Instructors, classrooms, and laboratories - with specific 
course numbers. The DOTS data base is organized by course. It contains course 
statistics and delineates training resource requirements for each course. The 
Requirements Specification Listing is organized by resource. It denotes all 
courses which have a requirement for that particular resource. For example, 
from Figure 1 1-2, Instructor group 003 is required 27 hours per course 51 OG 
convening and 105 hours per course 5698 convening. Room 180 in building N-30 
is required 42 hours per course 01 lA convening and 48 hours per course 536P 
convening. 

The specification listing also identifies the members of each instructor group 
by instructor number and name. Total available contact hours per Instructor 
are also noted. It should be pointed out that the instructor group numbers 
appearing in both the Requirements Specification Listing and the LP Optimal 
Solution and Sensitivity Analysis output are identical to each other, but are 
not related to the group number used in the DOTS data base. 

Instructor group numbers are not permanently assigned. The numbers are assigned 
sequentially each time the SCRR model is run and are a function of the set of 
courses included in the model run. The members of the instructor group will 
remain constant unless modified in the DOTS data base. For example, in the 
SCRR model run from which Figure 1 1-2 was extracted, instructor group 004 has 
two members — Atwood and Col burn. If the SCRR model was run for a different 
set of courses, Atwood and Col burn may become instructor group 002 or group 
037, or some other group number. However, regardless of the set of courses for 
which the SCRR model is run, Atwood and Col burn will always constitute one 
Instructor group as long as they are assigned to courses 510V and 510W. 
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DOTS 5U?W«t UTlllTt—SCM WOil INTERFACE 



INSTiUCtOII GROUP OOU NUMBER NAME 

1 HUNT 



HOURS 
1000 



COURSES! NUMBER CAPACUV COHVENINGS REQUtKEMEIiTS 
OIIA 10 U T6 



INSTRUCTOR GROUP 00^1 



NUMBER 
4»l 



NAMb 

VSERRETHER 



HOURS 
1000 



COURSESI NUMBE? CAPACITY COHVfeNlNGS REQUIREMENTS 



INSTRUCTOR GROUP OOX 



NUMBER 



HOUKS 
1000 



COURSESI NUMBER CAPACITY CONVfcNlNGS RE0UIRi:MENTS 



iNSTRUCrn.*^ GRUUP 004 1 



NUMBER 
129 



NAME 
ATHOUU 
C016URN 



COURSfcSt NUMRbR CAPACITY CONVfeNlNGS REWUlReMENrS 
<klOV 10 12 30 

51011 40 2* l» 



INSTRUCTOR GROUP 005l 



NUMBER 
1)2 
133 



NAME 

STREIT 
JUVCE 
STEMART 



COURSiSi NUMB£H CAPACITY CONVENtNCS MEOUlHEMENTS 
5101 16 24 100 




INSTRUCTOR GROUP 006 > 



NUMBER 
IS6 



counsel NUMBER CAPACITY CONVfiNlNGS MEQUIHEMENTS 
9S6K 10 SO 2B 



INSTMUCTOR GBOUP 00 I < 



NUMBER 
ISO 
ISI 



NAME 
mUSON 
BROMN 



HOUk^ 
1000 
1000 



COURSISI NUMBER CAPACITY CONVENINGS MEwUlREMENTS 
%%hP B U 



INSTRUCTOR GROUP OOBt 



NUMBER 
21 
22 



NAME 

OBERLE 
MAGNER 



HOURS 
1000 
1000 



COURSESI NUMBER CAPACITY CONVENINGS MEQUIREMENTS 
SMB 12 6 25> 



ROOM PLTINHGR * iOBO.O HOURS AVAILABLE. 

ROOM N«I9A120 - 20B0.0 HOURS AVAILABLE. 

ROOM N«mi22 - 20B0.0 HOURS AVAILABLE. 

ROOM N*)0 106 - 20B0.0 HOURS AVAILABLE. 

ROOM N-30 lOt * atOBO.O HOURS AVAILABLE. 

ROOM N*SO lOB - 20B0.0 HOURS AVAILABLE. 

ROOM N'-SO I6T - 20B0.0 HOURS AVAILABLE. 

ROOM N*SO ISO * 2OB0.O HOURS AVAILABLE;. 

ROOM N*SO IBI « 20B0.0 HOURS AVAILABLE. 



^lOM 




12.0 


SI07 




40.0 


5107 




20.0 


510G 




33.0 


5I0G 




27.0 


•>69t 




45.0 


5I6K 




20.6 


OIU 




42.0 


510V 




10.0 



569B 



536P 
5IOti 



105.0 



46.0 
6.0 
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LP OPTIMAL SOLUTION AND SENSITIVITY ANALYSIS - RESOURCE DATA. The linear pro- 
gramming module calculates the number of course convenings required to maximize 
student throughput. This portion of the SCRR model output specifies the level 
of resources required to attain the optimal number of course convenings. The 
output specifies the levels to which each Individual resource can increase and 
decrease before it is required to rerun the SCRR model. Also identified is the 
incremental student throughput change per unit increase or decrease up to those 
levels. This output assumes that the rest of the problem is unaltered; that 
is, the remaining input data are left constant, and the solution Is adjusted as 
necessary to maintain feasibility and optimal ity. 

Resource . An example of the LP Optimal Solution and Sensitivity Analysis - 
Rtsource Data output is shown in Figure II -3. The first column identifies the 
resources required by each of the courses processed by the model. The same 
resource name can be located in the Requirements Specification Listing which 
provides the model user with detailed resource data. For example, IGOOl in 
Figure II-3, is Identified as instructor group 001 in Figure II-2. From Figure 
I 1-2, only one instructor (No. 3, Hunt) belongs to the group. IGOOl instructs 
only one course; Oil A which requires 78 IGOOl contact hours per convening. 

Annual Availability . Column two in Figure II-3 (Annual Availability [Hours]) 
denotes the number of hours per year each resource If mailable to fulfill 
course requirements. Instructor group availability represents the sum of the 
availabilities of the individual members of the group. Individual instructor 
contact hour availability figures do not Include the following activities: 
supervisory duties; military duties; preparation for instruction; duties re- 
lated to instruction; annual leave; illness; special training; and break-in 
time. 

Ann ual Utilization. The annual utilization column identifies the number of 
Ttours per year each resource is required to achieve the optimal number of 
course convenings. 

Hours Underuti Viz ad. Hours underutilized or resource slack time represent the 
difference between annual availability and annual utilization. 

Percent Utilization . Percent utilization is the ratio of utilization to 
availability. 

Resource Utilization Range . The resource utilization range indicates the level 
to which each resource may be increased or decreased without rerunning the SCRR 
model. Changes in resource level beyond this range will necessitate modifyina 
the data base to reflect the new resource levels, and rerunning the SCRR model. 
Resource utilization changes within the specified range will affect the value 
of the optimal solution which is stated in terms of optimal student throughput. 
The magnitude of this effect (either positive or negative) is indicated. by the 
next column, Throughput Change Per Unit Resource Change. 

An example will illustrate the above explanation. IGOOl (from Figure II-3) 
utilization range is 936-2793 hours. IGOOl optimum utilization level is equal 
to its annual availability, or 1000 hours. If IGOOl availability were to 
decrease below 936 hours, the indicated optimal solution would change. From 
the Requirements Specification Listing (Figure I I -2), it is seen that 16001 
instructs course Oil A. Since minimum IGOOl requirements for course Oil A are 
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936 hours (78 hours per convening X 12 convenings per year), a decrease below 
936 hours would result in an infeaslble solution. 16001 utilization also can- 
not be extended beyond 2793 hours without changing the optimal solution. 

A utilization decrease in the range of 936-1000 hours would decrease the 
indicated optimum student throughput by 0.038 for each hour of decreased 
utilization. On the other hand, should utilization be allowed to increase be- 
yond the 1000 hour level, the optimal student throughput would increase by 
.038 per hour of Increased utilization. 

Throughput Change Per Unit Resource Change . This column identifies change in 
the optimal student throughput which will result from a one hour change in 
resource utilization. As long as the resource utilization level remains with- 
in the Indicated utilization range, the SCRR model need not be rerun. The 
effect of the resource change can be determined by a simple calculation using 
the throughput change per unit resource change. 

The sensitivity analysis output, in particular the Throughput Change Per Unit 
Resource Change column, assunes a continuous relationship between the parameter 
representing the course convenings and the resource requirements parameter. 
For example, if 10 contact hours are required to convene a course one time, 
it Is assumed that 11 contact hours will result in 1.1 course convenings, 15.5 
contact hou^s will net 1.55 convenings, and 20 contact hours will provide 2 
course convenings. Since all convenings are stated In terms of convenings 
per year. It Is possible to interpret a fractional convening as a course which 
convenes prior to the end of the year but does not conclude until the following 
year; I.e.* 0.5 convenings indicate that a course is one-half complete at the 
end of the year. However, except for this year-end Interpretation, fractional 
convenings have no meaning in the real world. Once a course is convened it 
Is always completed. Therefore, in reality the convening-resource relationship, 
although linear, is not continuous. It Is importaint that the model user keep 
this fact In mind when interpreting the sensitivity analysis output. 

Another example from the LP Optimal Solution and Sensitivity Analysis - Resource 
Data output (Figure 1 1-3) will be used to demonstrate the significance of the 
throughput change per unit resource change. The utilization range of IG002 
is Indicated to be 392-822 hours. IG002 annual availability is equal to 1000 
hours, while the Indicated optimal solution requires a utilization level of 822 
hours. If IG002 utilization were to decrease from 822 hours, the SCRR model 
would not have to be rerun since it can be seen from the throughput change 
column that student throughput will decrease by .149 for each hour of decreased 
16002 utilization. However, since In reality, instructor resources are not 
applied or reduced on an hour by hour basis, let us examine the time consequence 
of the above statement. Examination of Fiaure II-2 Indicates that iu002 in- 
structs course 5106. Sixty IG002 contact hours are required for 51 OG convening. 
Therefore, IG002 resource will be used In 60 hour increments. A 60 hour decrease 
in 16002 utilization will decrease total student throughput by 8.9 (.149 per 
hour X 60 hours). This is an interesting result. Since we are decreasing 
total 5106 convenings by one convening, we would expect the student throughput 
to decrease by 12 (5106 class capacity). The Limiting Variable column (see 
explanation and example in following subsection) indicates that 5698 convenings 
will change as 16002 utilization Is decreased. The connection becomes clear 
when we examine 16003 data In the Requirements Specification Listing (Figure 
II -2). Since 16003 Instructs both 5106 and 5698, 5106 convenings decrease and 
5698 convenings can be Increased, although not on a one-to-one basis. 
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The minimum IG002 requirement for course 5106 Is 360 hours (60 hours per con- 
vening X 6 convenlngs per year). The difference between the optimal IG002 
utilization level of 822 hours and the minimum 5106 requirements Is used to 
Increase the number of 510G convenlngs and, therefore, the student throughput, 
since (from Figure II-2) 16002 1s not qualified to Instruct any other courses. 
The ability to Increase 510G convenlngs Is meaningful only If corresponding 
increases In demand for course 5106 can be projected. If no Increased demand 
can be projected for 5106, then 5106 convenlngs should be maintained at the 
current level. If the decision 1s made to maintain the current level of 5106 
convenlngs, then IG002 will be underutilized 640 hours (1000 hours availability 
-360 hours required for 5106). These 640 hours could then be devoted to 
cross-training 16002 to qualify to Instruct additional courses (the SCRR model 
can assist In the Identification of courses which require additional instructors) 
or to perform other duties. 

Limiting Variable . This column Identifies the variable which limits the uti- 
llzation range. Again referring to Figure II-3 and resource 16001, the column 
labeled "Limiting Variable" Indicates that as 16001 utilization level Is de- 
creased from 1000 hours to a level of 936 hours, course 01 lA convenlngs will 
chanae. With the assistance of the Requirements Specification Listing (Figure 
II-2}t this fact becomes obvious. As the Instructor resource level Is decreased,, 
the number of course convenlngs must also decrease since these two variables 
are directly proportional. Similarly, as 16001 utilization Is Increased above 
the 1000 hours level, course 536P convenlngs will decrease. Since OllA and 
536P share the same classroom (see Figure I I -2), as OllA convenlngs Increase, 
536P convenlngs must decrease. The minimum 536P requirement for classroom 180 
In building N-30 Is 576 hours (48 hours per convening X 12 convenlngs per year). 
The remaining availability of room 180 becomes 1504 (2080-576) hours. Since 
Oil A requires 42 hours per convening, course OllA can theoretically be convened 
35.81 times in the remaining 1504 hours. 35.81 convenlngs X 78 hours per con- 
vening establishes the 2793 hour upper limit for 16001 utilization. 

LP OPTIMAL SOLUTION AND SENSITIVITY ANALYSIS - COURSE DATA. The optimal number 
of annual courso convenlngs which will maximize student throughput is calculated 
by a linear programming technique. The sensitivity analysis provides informa- 
tion regarding the sensitivity of the optimal solution to changes in the Input 
data, and the solutions that result from such changes. The levels to which the 
class capacity and the number of annual convenlngs can increase and decrease 
before tne optimal solution changes are contained in the course data section 
of the LP Optimal Solution and Sensitivity Analysis output. It also gives the 
Incremental change in student throughput per unit increase or decrease in 
course convenlngs up to these levels. As with the resource data output, the 
course data sensitivity analysis assumes that variables are changed individually 
and that the rest of the problem remains unaltered. A sample of the LP Optimal 
Solution and Sensitivity Analysis - Course Data output is shown in Figure II-4. 

Course CDP Number . All courses are identified by the four digit CDP number. 

Maximum Annual Convenlngs . This column lists the optimal number of annual 
course convenlngs for each course. The optimal number of convenlngs is that 
number of convenlngs which maximize total student throughput subject to the 
resource limitations identified in the previous output section. Any other 
combination of numbers of convenlngs for the same set of courses is either not 
feasible or will result in a lower student throughput. As an example, the 
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optimal number of convenings for course Oil A Is shown to be 12.8 (from Figure 
1 1-4). Since the number of convenings Is established for a one year period, 
fractional convenings can be Interpreted to mean that the course was convened 
but not completed in the same year. Therefore, 12,8 convenings are equivalent 
to 13 convenings with the last being eighty percent complete at the end of 
the year. 

Current Schedul ed Conveni ngs . The current number of scheduled convenings 
listed In this column Is identical to the number of convenings stored for each 
course in the DOTS data base. This number is established as a lower bound for 
the maximum annual convening paratneters discussed above. In effect, the lower 
bound represents an additional constraint to the LP problem. The constraint 
to the variable representing the number of convenings for course Oil A states 
that Oil A convenings must be greater than or equal to 12. 

Class Input Capacity . The Class Input Capacity is also retrieved from the DOTS 
^data base. The class capacities are the LP objective function coefficients. 
Student throughput Is established by multiplying the capacity of each class 
by the optimal number of convenings calculated for that course. 

Capacities are based upon training considerations such as instructor to student 
ratio, availability of training equipment, workshop, laboratories, and mock-up 
facilities, as well as physical considerations such as classroom size. 

Annual Convenings Range . The Annual Convenings Range indicates the upper and 
lower limits for the number of annual convenings parameter. The current LP 
solution remains optimal for all values of the convenings parameter within this 
range. However, as the number of annual convenings is varied from the indicated 
optimal, the maximum student throughput will either increase or decrease by the 
factor printed in the next column, Throughput Change Per Course Convening Change. 
The specified lower bound, which is the number of current scheduled convenings. 
Is ignored in calculating the range of annual course convenings. Fo»* example, 
the range of annual convenings for course 510W is -6.7-91.1. The solution 
which maximizes student throughput is 91.1 convenings. The current number of 
scheduled convenings is 24 per year. If 10 convenings less than the optimal 
91.1 were scheduled, the total student throughput would decrease by 40 (4 per 
convening). Note that the student throughput drops by only 4 per convening, 
in spite of the fact that 51 OW class capacity is 10. From Figure 1 1 -2 we see 
that courses 510V and 51 OW utilize the same instructor group. Therefore, as 
51 OW convenings t-^e decreased, additional convenings of 510V can be scheduled. 
But since 510V uses more instructor resource per convening, less 510V convenings 
can be scheduled with the resources made available by reducing 510W convenings. 

The Annual Convenings Range also provides an indication of the effect of class 
size on the LP optimal solution. The current solution will remain optimal for 
class sizes in the range notgd by the Class Capacity Range column. As the 
class size drops below the capacity range minimum, the optimal number of con- 
venings will decrease to the convening range minimum, if that quantity is 
greater than the current number of scheduled convenings. If the convening 
range minimum is less than the Current Scheduled Convenings, then the optimal 
number of course convenings will be set equal to the Current Scheduled Con- 
venings. For example, from Figure II-4, the optimal number of convenings for 
course Oil A is 12.8 based on a class size of 10 students. Should the class 
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size drop below seven (Class Capacity Range minimum), the optimal number of 
convenings would decrease to 12 since the Annual Convening Rar^e minimum (1.9) 
is less than 12. 

The optimal number of annual convenings for course 510G is 13.7 for a class 
size of 12. If the class size drops to three or less, the optimal convenings 
for that course will decrease to the Annual Convening Range minimum (6.5), 
rather than the Current Scheduled Convenings (6.0). The student throughput 
for the new optimal solution will decrease by 64.1 (decrease of 7.2 convenings 
X 8.9 student throughput decrease per convening). 

Throughput Change Per Course Convening Change . This column indicates the change 
In the optimal student throughput which will result from a change in the number 
of course convenings. As long as the number of course convenings remains within 
the range indicated by the Annual Convening Range column, the SCRR model need 
not be rerun. The effect of a change in the number of convenings can be deter- 
mined by a simple calculation using the Throughput Change Per Course Convening 
Change. Again, referring to Figure II-4, if course 5698 convenings were to in- 
crease from the six per year optimal to seven per year, the total student through- 
put would decrease by 34.7. From Figure ii.2» courses 5698 and 510G share 16003. 
Increasing 5698 -conveni ngs from 6.0 to 7.8 shifts 189 hours of IG003 time from 
510G to 5698. This 189 hour shift increases 5698 convenings by 1.8, but reduces 
possible 510G convenings by 7 (189 t 27 hours per 510G convening). Therefore, 
student throughput will drop even though 5698 convenings are increased. 

Class Capacity Rang e. This column indicates the range of class capacities for 
whi ch the 1 n^ catedopt Imal number of course convenings will remain unchanged. 
A decrease in class size to below the capacity range minimum will cause the 
optimal number of convenings to decrease to either the number of current sched- 
uled convenings or the convening range minimum, whichever is greater. An in- 
crease in class size to beyond the capacity range maximum will increase the 
number of course convenings to the convening range maximum. Using course 510V 
from Figure I 1-4 as an example, if the class size were Increased from the current 
level of 10, to 17 or more, the optimal number of convenings would Increase to 
52.3 per year from the current level of 12. 

Limiting Variable . This column identifies the variable which limits the con- 
venings range and whose value will change as a result of a variation from the 
optimal convening level within the course convening range. Several examples 
from Figure II-4 will clarify the significance of this column. As the number 
of course 01 1A convenings are decreased from the indicated optimum, IG001 
utilization will decrease from the 100 percent shown in the SCRR output. This 
relationship is obvious since a decline in convenings will result in lower 
resource requirements. 

As course 51 OG convenings decrease from the optimal, course 5698 convenings 
will Increase from the Current Scheduled Convenings level. IG003 is shared 
by courses 510G and 5698. A decrease in 510G convenings, will Increase the 
level of IG003 resources available for course 5698. Decreasing course 510G 
convenings will reduce the total student throughput by 8.9 per convening 
deleted. 
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Reducing course 5698 convenings from 6 to 5.2 w111 Increase IG002 utilization. 
At 5.2 convenings, I60O2 utilization will reach 100 percent. Therefore, a 
decrease In 5698 convenings below 5.2 will result In a Throughput Change Per 
Unit Resource Change other than 34.7. Similarly, 5698 convenings can be 
Increased to 7.8 per year by Increasing IG008 utilization to 100 percent. 

MODEL/DATA BASE COMMUNICATION 

The values for all input parameters which must be supplied to the SCRR 
model are stored in the data base. These parameter values are accessed and 
processed by the SCRR model component which formulates the LP objective function 
and constraint equations. The data accession process does not require u^er in- 
tervention, however, the user may limit the amount of data processed by the 
model to one or more schools. Unless specific school names are identified on 
the model control card, all training complex schools will be processed. 

Data flow between the data base and the SCRR model 1s strictly one way. There 
Is no direct feedback from the model to the data base. Data base maintenance 
Is performed Independently of model operation. 

To demonstrate SCRR model and data base interaction, the resource requirement 
algorithm will be discussed in detail. The algorithm is implemented within the 
LP problem formulation module. The objective of the algorithm is to extract 
from the data base the data elements required to construct the Resource Require- 
ment Matrix shown 1n Figure II -5. ^ 

I'' 

The data base printout for course (COP number) 536K Is presented in Figure II-6. 
The first step in the algorithm is to calculate the Instructor requirement for 
the course. Two Instructors are required for eight hours of lab work, and one 
Instructor is required for twelve hours of classroom presentation. The total 
Instructor contact hour requirement for course 536K is 28 hours. All require- 
ments are fulfilled by instructor group 1. There are two Instructors (135 and 
136) currently assigned to course 536K who belong to Instructor group 1. From 
the Instructor data base (Figure II-7)» it is determined that both instructor 
number 135 and 136 are available 1000 hours per year. Therefore, the total 
availability of Instructor group 1 is 2000 hours. The absence of related 
course data for 536K indicates that Instructors 135 and 136 are not currently 
Instructing any additional courses. With this Information, the first row of 
the Resource Requirement Matrix (Figure II-5) can be completed. Twenty-eight 
Instructor group 1 contact hours are required per convening of course 536K. 
Instructor group 1 has a total annual availability of 2000 hours. 

Returning to Figure II-6» it is seen that 536K has an additional requirement of 
20 hours per convening for classroom 167 in building N-30. The same room is 
used for both classroom and lab sessions. It has an annual availability of 
2080 hours. This Information is also transferred to the requirements matrix. 

Finally, the algorithm calls for the establishment of the minimum number of 
annual convenings for 536K. The number 50 Is read from the data base and 
temporarily stored with the requirements matrix. When the requirements matrix 
has been established for all specified courses, the data are reformatted for 
Input to the LP routine. 
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The resource requirement algorithm Is repeated for course 5107. The algorithm 
sequentially numbers the instructor groups as they are added to the require- 
ments matrix. Course 5107 has a requirement of 100 instructor group 2 contac'. 
hours per convening. Instructor group 2 annual availability is 3000 hours. 
Classrooms 120 and 122 in building N-19A are required 40 and 20 hours re- 
spectively per convening. To fulfill minimum training requirements , course 
5107 must convene at least 24 times per year. 

One final ei-ample in which a single course is instructed by multiple instructor 
groups and ^ single instructor group instructs more than one course, will be 
examined. Referring again to the Resource Requirement Matrix, Figure II-5, 
It can be seen that both course 51 OG and 5698 have requirements for two in- 
structor groups and that one of these groups instructs both courses. The re- 
quirements algorithm first calls the data elements describing course (CDP 
number) 510G from the data base (see 510G data printout, Figure II-8). Contact 
hour requirements are specified for two instructor groups. Instructor group 1 
Is required for 33 hours of classroom lecture, plus an additional 27 hours of 
lab, for a total of 60 hours per convening. Only one instructor (41) currently 
assigned to course 5106 is included in Instructor group 1. From the instructor 
file (Figure II-9), instructor 41 is available 1000 hours per year. Since no 
related courses are specified for instructor group 1, the above information is 
entered in the requirements matrix (Figure 1 1-5) in the instructor group 5 row. 
Group numbers are sequentially assigned in the construction of the require- 
ments matrix and have no meaning except to differentiate between groups. 

Referring back to Figure 1 1 -8, Instructor group 2 is required 27 hours per 
convening for lab instruction. Instructor group 2 consists of only one in- 
structor (40) who (from the Instructor file. Figure II-7) is available 1000 
hours per year. However, from the related course data. Instructor group 2 is 
also utilized for course 5698. Course file data for course 5698 are presented 
In Figure II-9. Instructor group 2, whose sole member is instructor 40, is 
required 105 hours per convening of course 5698 for lab instruction. The re- 
quirements matrix, shows a requirement of 27 hours per convening of course 51 OG 
and an additional requirement of 105 hours per course 5698 convening, against 
a total availability of 1000 hours for instructor group 6. 

The convening frequencies and space requirements for courses 5106 and 5698 
were also read from the course file and entered in the requirements matrix 
according to the procedures previously described. 

All Resource Requirement Matrix data plus the identification of Instructor 
group menders, are available to SCRR model users in the Requirements Speci- 
fication Listing. 

LOGIC DESIGN 

A mathematical model of a system is a collection of mathematical relation- 
ships which characterize the feasible solutions of the system. By feasible 
solutions, is meant those solutions which can be carried out under the system's 
limitations. The technique utilized to solve the SCRR mathematical model is 
linear programming. Linear programming establishes the optimal system 
solution by Iteratively evaluating feasible solutions against an expressed 
objective. Before the linear programming technique can be used, several 
basic requirements must be fulfilled. This section will discuss these basic 
requirements and demonstrate that these requirements are fulfilled by the 
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SCRR model application. Also included in this section is a discussion of the 
real world interpretation of a linear programming optimal solution. Assumptions 
and limitations relative to the SCRR frathematical model variables are also 
discussed. 

LINEAR PROGRAMMING BASIC REQUIREMENTS. As the name "linear programming" implies, 
both the objective function and every constraint function must be linear. 
Linearity is a primary requirement of linear programming. A linear relationship 
Is essentially defined by two properties, proportionality and addltlvity. In 
addition to these two major characteristics, three additional requirements must 
be adhered to: nonnegativity, divisibility; and deterministic coefficients. 

Proportionality . Linearity requires a proportionality or a simple multiplica- 
tlve relatlonsnip between the units of resource requirements and the number of 
convenings of each course. For example, if six Instructor 1 contact hours are 
required to convene course A one time, then 12 hours are required for two con- 
venings, and 24 hours are required for four convenings, etc., assuming a constant 
class size. The amount of resource required is the same for the n-th convening 
as It Is for the first. This Is an important property of linearity from the 
practical point of view. If, for example, it was the case for some Instructional 
curriculum that 60 hours of a given resource were required to attain 30 convenings 
of some course, but only 100 hours of the resource were required to attain 60 con- 
venings of this course, then the proportionality assumption would not hold. It Is 
obvious, assuming that class size Is held constant for each model run that for the 
SCRR model application, the resource requirements are proportional to the number 
of course convenings and to the student throughput for a constant class size. The 
objective function of the current SCRR model formulation is to maximize student 
throughput based on specified course capacities. Course requirements are calcu- 
lated based on a constant class capacity. Subsequent model runs may be made for 
different class sizes. Therefore, for each model run, throughput will be 
linearly related to resource requirements. 

Addltivlty . The additlvlty property of linear relationships states that the 
measures of effect as calculated through the objective function, and the levels 
of resources as expressed In the constraint equations, must both be additive. 
The objective function measure of effect Is student throughput, which is cal- 
culated by multiplying the course capacity by the number of convenings. Thus, 
if course A's capacity Is 6 and It Is convened 10 times each year, the annual 
throughput for A Is 60, and If course B has a capacity of 20 and Is convened 
15 times per year. Its throughput is 300. The additlvity property states that 
the total throughput for the two courses Is then 360. A similar example will 
demonstrate the additlvlty property's Involvement in the constraints of the 
linear progranrclng model. Instructor 1 teaches both courses A and B. Twenty- 
five hours of his time are required for each convening of course B. Since A 
meets ten times each year and B fifteen times. Instructor Ts total require- 
ment Is 400 hours (250 for A and 150 for B). Like the above example, all SCRR 
model resource requirements are additive across all courses. 

Nonnegativity . The nonnegativity property states that while any positive 
multiple of course convenings Is possible, negative course convenings are not 
possible. Adherence to this restriction Is ensured through the MPSX program. 
The MPSX program allows the user to specify both upper and lower bounds for 
the decision variables. If a lower bound is not specified, the program assumes 
a value of zero. Unspecified upper bounds are set equal to Infinity. In the 
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case of the SCRR model application, the LP problem formulation algorithm sets 
the lower bound for course convenings equal to the number of annual convenings 
(which Is always a positive quantity) stored in the data base. A negative 
number of course convenings is meaningless. 

Divisibility . The divisibility property requires that fractional levels of 
the decision variables be permissible. In many linear programming models, the 
decision variables would have physical significance only if they have integer 
values. There is no guarantee that the solution procedure utilized within the 
SCRR model will yield an Integer Solution. If an integer solution is required, 
the common procedure is to round the non-integer optimal solution down to the 
nearest integer. This course of action could produce two problems. First, 
this Integer solution need not be feasible. Second, even if it is feasible, 
this solution need not be too near optimal ity. Since fractional values for the 
number of course convenings is Interpretable, the SCRR model application ful- 
fills the divisibnity property requirement. A fractional course convening is 
Interpreted as a course which is convened but is not completed In a calendar 
year. For example, 0.5 convenings could be associated with a two week course 
which is convened the last week of a calendar year. In the event that the 
decision Is made sometime in the future to consider only Integer- valued number 
of convenings, the SCRR model could be easily modified to handle this restric- 
tion, since MPSX has integer programming capability. 

Deterministic Coefficients . All of the coefficients in a linear programming 
model are assumed to be known constants. In the SCRR model application, this 
Includes class capacities, instructor and space requirements per convening, and 
Instructor and space availabilities. The fact that any or all of the LP co- 
efficients may not be known constants does not invalidate model results, but 
does require the expenditure of additional effort. (A sensitivity analysis is 
generally performed to determine the effect on the optimal solution if par- 
ticular parameters take on other possible values.) Sensitivity analysis is 
employed to determine the effect of changing the value of a single parameter. 
It is often of interest to Investigate making simultaneous changes in a number 
of parameters and to study what happens as the magnitude of these simultaneous 
changes increase. A systematic study of such changes in certain parameters of 
a linear programming model Is the objective of parametric linear programming. 
A post optimal sensitivity analysis is built into the SCRR model. Sensitivity 
analysis results are included in the SCRR model output. Parametric programming 
may be performed by the model user by systematically varying the parameters of 
interest, rerunning the SCRH model, and comparing results. 

INTERPRETATION OF LP OPTIMAL SOLUTION. The SCRR model can be operated in two 
different modes. The number of course convenings can be specified by the user. 
The model will then calculate the resources required 'to achieve that number of 
convenings, and compare the required resources with present resource capabilities. 
On the other hand, the SCRR model could be run against the data base which 
depicts current resource capabilities and specifies a minimum number of course 
convenings. The model will determine the maximum student throughput which could 
be attained with current resources. Model results from the former operating 
mode are straight- forward and require no additional explanation. Interpreta- 
tion of model results in the latter case is more complex. 

Consider the following example. Course A is currently schedu.ed to convene 24 
times per year. The SCRR model is run to optimize throughput based on current 
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resources. Model results indicate that course A should be convened 93.7 times 
per year! Since the user is aware that course A utilization is currently 
averaging about 70 percent and a reduction in convening frequency is being 
considered, the model results appear absurd. However, the objective of the 
SCRR model was to maximize throughput, which is defined as course capacity 
times the number of convenings, subject to current resource capabilities. 
Throughput can be increased only by increasing convening frequency. Con- 
vening frequency is limited only by available resources. Capability to in- 
crease convening frequency to nearly four times the current schedule implies 
that present course A resources are being utilized approximately 25 percent 
of the available tiniel Therefore, the question the SCRR model user should be 
considering is not should course A be convened 93 times per year, but how can 
course A resources be utilized more effectively? Resource availabilities 
stored in the dita base should be examined. Perhaps the original availability 
estimate was too high. Frequent curricula updates may reduce the time avail- 
able for classroom instruction. Or the instructor(s) could be cross-trained 
to instruct one or more additional courses. The same model output which in- 
dicated 93.7 convenings for course A, may also have pointed out other courses 
which could not meet minimum convening requirements because of lack of resources. 

The user should investigate all the above possibilities. Model input parameters 
could be modified and the model rerun to assist in the evaluation of the feasible 
alternatives. 

ASSUMPTIONS AND LIMITATIONS OF SCRR MODEL VARIABLES. The laboratory and class- 
room facilitiesi i.e., the number of spaces available for rourse presentation, 
lab equipment, training aids, and other major equipment installed in these 
spaces, are considered to be fixed in their availability in the short run (up 
to two years), but variable- over longer time spans. Therefore, a time lag of 
from one to two years is assumed between a decision to procure major equipment 
or to construct classroom or lab facilities, antt the completion of the installa- 
tion or construction. 

Although short-range availability of classrooms and laboratories is considered 
fixed, an estimate of the availability of individual classrooms or labs has not 
been attempted. A uniform availability of 40 hours per week for 52 weeks per 
year or a total of 2080 hours per year has been assumed for all classroom and 
laboratory spaces. The SCRR model user has three options relative to space 
availability: (1) maintain the assumption of a uniform 2080 hours per year 
availability; (2) establish the availability on a room by room basis for the 
training complex; or (3) utilize the SCRR model to perform parametric studies 
to determine the effect of facility availability. 

The authorized allowance of instructors is considered to be fixed in the short 
run. The actual on-board count of instructors is considered variable in both 
the short and the long run. In the short run, variations in the on-board 
count may be caused by many factors (temporary additional duty, vacations. 
Illness, time lag between assignment rotation and receipt of replacement). In 
the long run, higher authorities can change the instructor allowance as a 
function of major changes 1n curriculum or requirements, changes in conmand 
mission, or the general level of manpower authorizations. 

On-board Instructor count can be easily maintained within the data base. How- 
ever, given on-board count, the key SCRR model variable becomes instructor 
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availability. Instructor availability is the number of hours per year an 
instructor has available for classroom instruction. Availability does not 
include supervisory requirements, military duties, preparation for instruction, 
duties related to instruction, annual leave, illness, special training, or 
break-in time. Both average instructor availability and individual instruc- 
tor availability are unknown at this time. Availability standards ranging 
from 750 hours per year up to 1250 hours oer year have been used by various 
organizations at different points in time^. The current Design of Training 
System (DOTS) data base shows instructor availability equal to 1000 hours 
per instructor per year. This number was selected because it represents the 
average of two documented standards. The intention is not to establish 1000 
hours per year as a new instructor availability standard, but to use this 
number as a point of departure from which a more meaningful standard can be 
derived. 

Individual instructor availability could potentially range from as high as 
1500 hours per year to a minimum in the range of 100-200 hours per year, as a 
function of the amount, of course related duties, administrative duties, etc. 
Availabilities for all instructors should be established by their respective 
school directors and entered in the DOTS data base. 

The SCRR model should be utilized to perform a parametric analysis of instruc- 
tor availability. Varying instructor availabilities from 700 to 1500 hours in 
100 hour increments will provide training complex officials with an estimate 
of the sensitivity of training complex capabilities to Instructor availability. 

It is assumed that budget does not constrain the SCRR model solution In the 
short run. However, in the long run, budget constraints of a capital nature 
may alter the SCRR optimal solution, in that student throughput could be 
affected by the funding available for new construction and/or procurement of 
new equipment. 

Course curricula are considered fairly 1ne"iastic in the short run. Drastic 
curriculum changes require a considerable amount of time to determine new re- 
quirements, develop new material, and secure headquarters review and approval. 
However, numerous minor changes to courses take place frequently, and a course 
may be dropped as a result of sustained low utilization. 

Student/ instructor ratios are generally a function of curriculum requirements. 
The generally accepted rule used in the establishment of these ratios is that 
the ratio of trainees per instructor for each instructional situation, should 
be set at that point which yields the highest possible ratio without serious 
detriment to the quality of instruction. 

The optimum ratio should be based on consideration of the type of equipment, 
safety, and teaching effectiveness for the particular teaching situation. 
Since no more specific procedures other than the above exist, the establish- 
ment of student/instructor ratios remains highly subjective, and should be 
closely monitored by training complex officials. 



These figures are from BUPERSINST 1510.150 and CNTECHTRAINST 5311. lA 
respectively. 
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The current version of the SCRR model calculates all instructor requirements 
assuming 100 percent course utilization. The result of this assumption is 
that requirements are overstated for those courses which are consistently 
underutilized and whose instructor requirement is a function of class size. 
For example, course number J-780-0406, Damage Control /Firefighting, Shipboard, 
has a 12:1 student/instructor ratio for 10 hours of the firefighting portion 
of the course. The normal class capacity is 144. Thus if the course were 
100 percent utilized, 12 instructors would be required for that 10 hour section 
of the course. However, if the course were averaging only 50 percent utiliza- 
tion, the Instructor requirement would drop to six for the same portion of 
the course. 

The SCRR model will be modified to include the impact of course utilization 
during Phase III of this project. 

LEVEL 1 VALIDATION SCENARIOS 

The purpose of the level 1 validation scenarios is to objectively demon- 
strate that all subelements of the SCRR model will perform the functions iden- 
tified in the model description section (page II-l). Four scenarios will be 
presented in this section. The first two will exercise the SCRR model against 
the total DOTS data base. These scenarios have been designed to test each 
model subroutine, while simultaneously establishing model limitations with 
respect to problem size. The last two scenarios will demonstrate how the SCRR 
model can be used to assist training officials In the analysis and solution of 
typical problems. 

SCENARIO 1 - EXECUTE THE SCRR MODEL USING THE ENTIRE MASTER DOTS DATA BASE AS 
INPUT DATA. The objective of this validation scenario is threefold: 

a. To determine if the SCRR model software can process the entire 125 
course data base within the storage limitations (120K) of the 
development computer. 

b. To audit the SCRR interface and output formatting programs. 

c. To audit the data base contents. 

Scenario Input Data . This scenario requires no input data preparation. The 
model user need only select the appropriate Job Control Language (JCL) card 
deck (see SCRR model operating procedures. Volume III, Section II), and 
specify the master DOTS data base as the data source. The SCRR model inter- 
face program will then access the master data base, select the data elements 
required to formulate the linear programming problem, and prepare the input 
data for the MPSX module. The MPSX module solves the linear programning 
problem and passes the solution to the output formatting program, which 
prints the LP solution and sensitivity analysis results. 

Special Run Conditions . Scenario 1 will formally test the following SCRR model 
software : 

a. JCL to execute SCRR model from master data base. 

b. All SCRR model Interface prograrr codes. 
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c. MPSX control program. 

d. All output formatting program codes. 

Design Criterion Tested . The core of the SCRR model is a linear programming 
computational technique. Since the time of its development nearly 30 years 
ago* linear programming has become accepted and widely used by both theoretical 
and applied mathematicians. The software package used to calculate the linear 
programming solution for the SCRR model is MPSX (Mathematical Programming Sys- 
tem Extended), an IBM Program Product. Neither the linear programming technique 
nor the MPSX software will be subjected to validation testing. 

The application of the linear programming technique to the problem of deter- 
mining the best use of resources to meet training requirements, has been 
Initially discussed in the logic design section (pagen-24). The SCRR model 
linear programming problem formulation fulfills tne basic mathematical pre- 
requisites of proportionality and additivity. An important part of the valida- 
tion testing is the determination that the linear programming model formulation 
approximates the real world to an acceptable degree. Several discussions 
relative to the evaluation and interpretation of model results have been In- 
cluded in the output parameter description subsection and the logic design sub- 
section. Comparisons of model solutions with expected results will be included 
In the discussion of test results. 

The validation scenarios have, therefore, been designed to test the following 
design criterion: 

a. The SCRR model software must correctly manipulate the data elements 
in the process of formulating the LP problem. 

b. The linear programming model must approximate the real world to an 
acceptable degree. 

Test Run Output . Because of the volume of output data, the complete scenario 
1 results will not be reproduced in this section. Excerpts from the SCRR 
model output will be provided to demonstrate that the model has met Its design 
objectives. 

Requirements Specification Testing. Two pages of the Requirements Specification 
Listing are presented in Figure 11-10. The accuracy of the data contained in 
this output listing can be verified by comparing them to a listing of the data 
base contents. For example, Figure 11-10 Indicates that instructor group 001 
(IGOOl) has only one member - Instructor number 196. 16001 instructs only 
course 007E. IGOOl contact hour requirements for 007E is 90 hours per con- 
vening. The data base listing for course 007E is shown in Figure 11-11. 
Instructor 196 is one of two instructors listed as currently assigned to course 
007E. The two Instructors are internally differentiated by the group desig- 
nator. Instructor 196 is identified as group 1. Group 1 is required for 54 
hours of lab and 36 hours of theory presentation, a total of 90 hours. Group 
1 does not appear in the related course data, which Indicates that instructor 
196 Is not Instructing any additional courses. 

Figure 11-11 indicates that Instructor 213 is also assigned to course C07E. 
He is one of two instructors required for the 54 hours of lab instruction. 
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INf^TRUCTOR GAOUP 001 : NUMBER NAMf ^qukS 

196 CHIUORES 1000 

COURSES: MiJMH^R CAP&CITV CONVENINGS REUUIPf'Mf NTS 
007t 4 ^ «0 



INSTRUCTOR GROUP 002: 



NUMBER NAME 
213 MCCLEARN 



HOURS 
)000 



COURSES: NUMBER CAPACITY CONVENINGS REwUIPEMFMS 
n07E 4 54 

INSTRUCTOR GROUP 003: NUMBER NAMf: mQURS 

) HUNT 1000 

COURSES: NUMBER CAPACITY CONVENINGS P|;UUtPbMFNTS 
OIU 10 li 78 

INSTRUCTOR GROUP OOot NUMBER NAME HOURf; 

137 OUOLEY 1000 
UO ENGLAND 1000 

COURSES: NtJMBEH CAPACITY CONVENINGS REQUIREMENTS 
0129 20 $0 75 

U20 10 2^ 92 



INSTRUCTOR GROUP OlS: 



NUMBER 
241 



FLORA 



NAME 



HOURS 
1000 



COURSES: NUMBER 
9 4dR 



CAPACITY CONVENINGS REQUIREMENTS 
4 5 75 

^ 4 94 



INSTRUCTOK GROUP 0161 



NUMBER 
215 



NAME 



WARD 



HOURS 
1000 



courses: number 

^ )47W 
INSTRUCTOR GROUP 



COURSES: NUMBER 
347Y 
34BA 
54BC 

INSTRUCTOR GROUP 



CAPACITY CONVENINGS REQUIREMENTS 
4 4 60 

0372 NUMBER NAME HOURS 
217 JAMES 1000 

CAPACITY CONVENINGS REQUIREMENTS 
4 4 100 
4 2 100 
4 2 100 



COURSES: NUMBER 
3495 

INSTRUCTOR CROUP 



COURSES: NUMBER 
350S 



OiBi NUMBER NAME HOURS 

151 OUCHARME 1000 

152 SILVER 1000 

CAPACITY CONVENINGS REQUIREMENTS 
4 B 262 

03«i NUMBEK NAME HOURS 

222 NAY 1000 

CAPACITY CONVENINGS REQUIREMENTS 
4 9 60 



FIGURE 11-10 SCENARIO 1 - REQUIREMENTS SPECIFICATION LISTING EXCERPT 
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FIGURE Il-n DATA BASE LISTING - COURSE 007E 
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FIGURE 11-12 DATA BASE LISTING - COURSE 347W 
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From the related course data, instructor 213 also instructs course 347W. This 
information is duplicated in the specification listing. Examination of the 
data base listing for course 347W, indicates that instructor 213 is utilized 
for 40 hours of lab instruction and Is also instructing course 007E. 

Examination of Figure 11-12 shows that instructor 215 is required for 20 hours 
of theory and 40 hours of lab instruction for each course 347W convening. He 
does not instruct any additional courses. Instructor 215 is the only member 
of IG036 (Figure 11-10). Again, the SCRR interface output agrees with the 
data base listing. 

Classroom and lab requirements are also compiled and summarized by the SCRR 
interface program. The data presented in Figure 11-13 for classrooms N-25A 
113 and N25A 139 agree with the data base listing for each course. 

Formatted MPSX Input Data. The second phase of the SCRR interface program 
reformats the linear programming problem matrix, containing course require- 
ments for instructors and classrooms, to meet MPSX input requirements. 
Examination of the formatted MPSX input (Figure 11-14) will verify that the 
Interface program has successfully manipulated the requirement matrix to pro- 
vide the MPSX routine with accurate input data. The left column in Figure 
11-14 is the course number; class capacity is designated by "thruput"; 
instructor and classroom requirements are in hours per convening. 



007E 


THRUHUT 


4.00000 


IGOOl 


90.00000 


0076 


ir>on2 


54.00000 


N-25A1)9 


90.00000 


OllA 


THrtUPUT 


lO.OOUOO 


IGOOl 


78.00000 


OllA 


\-30.18U 


42.00U0O 






0129 


THRUHUT 


20.00000 


ir,004 


75.00000 


0129 


I r.nns 


15.00000 


L-28.MPC 


15.00000 


0129 


L-2M.MPL 


15.00000 






019b 


THKlJPUT 


2n.oo.')Oo 


10006 


120.00000 


0196 




12U. 00')00 






02S4 


TrmiJPlJT 


25.O0U0O 


ir,007 


24.00000 


02B4 




6.00000 


N-19A202 


to. 00000 


0286 


Thruput 


25. OOOUO 


IGOO) 


30.00000 


0286 


>i-l9A204 


30.0000U 




0294 


thkuput 


25.00003 


IGOOR 


6.00000 


0294 


luOlO 


24. 00000 


N-19A2u2 


30.00000 


0296 


THRUHUT 


?5. 00000 


IGOOV 


60.00000 


0296 


N-I9ft^0^ 


60. OOUOO 






0402 


THRUPUT 


d. 00000 


IGOU 


60.00000 1 


0402 


n>012 


48.00000 


N-25A144 


60.00000 


1391 


TriRUPUT 


24.00000 


1L.013 


60.00000 


1391 


N- 30. 176 


6. 50000 


30. 244 


51.50000 


210S 


THRUPUT 


6. OOUOO 


I&014 


lOH. 00000 


2109 


N- i9A207 


60u 00000 






239H 


THRUPUT 


20.00000 


1G015 


42.00000 


2398 


324 


36.00000 




2399 


THRUPUT 


16.00000 


1G016 


18.00000 


2399 


N-:0.207 


IB. 00000 




304U 


THRUPUT 


6.00000 


10017 


60.00000 


304U 


ICU18 


18. 00000 


IG019 


41. OOOUO 


30^U 


N-2'>A231 


60.00000 




3052 


THRUPUT 


8.00000 


IG019 


37.00000 


3052 


1G020 


137. OOUOO 


N-25A167 


47.00000 



FIGURE 11-14 FORMATTED MPSX INPIIT EXCERPT 
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SCRR Output - Resource Data. The objective of. the SCRR linear programming 
model was set to maximize student throughput (see operating procedures, 
Volume III. Section II. Page II-8). Because the availability of several 
resources was less than the minimum requirement, the MPSX routine could not 
I;®?r feasible solution to the stated problem. For example. Figure 
11-15 indicates that IG004 has a total availability of 2000 hours. IG004 
utilization, which in this case is equivalent to the minimum IG004 require- 
ment. Is 5958 hours. A feasible solution cannot be identified until IG004 
availability is equal to or greater than the specified minimum requirement. 
All negative quantities in the "hours under utilized" column in Figure 11-15. 
represent Insufficient resource availability. In all. 26 infeasibilities 
were discovered in the master data base. Each of these infeasibilities was 
checked to determine if the source of the error was the SCRR model software 
or the data contents of the master SCRR data base. In all cases, the SCRR 
output was found to be totally accurate. 

The SCRR - Resource Data. The SCRR output from scenario 1 provides an excellent 
tool for auditing the master DOTS data base prior to installation of the model 
at the test location. Each of the resource infeasibilities should be examined 
to ascertain the possible cause or causes. Requirements could have been over- 
stated because of a low student/ instructor ratio. A low course utilization 
rate will also Inflate requirements, since requirements are currently calcu- 
lated based on class capacity and do not consider utilization rate. For 
example, 16062 and 16063 show requirements greatly in excess of availability. 
We find, from the specification listing, that both these instructor groups' 
Instruct course 509V (Damage Control/Firefighting, Shipboard). This course 
can handle up to 288 students simultaneously (144 in the Firefighting portion 
and 144 in the Damage Control section). Even with a student/instructor ratio 
of 24:1, six Instructors from Firefighting and six instructors from Damage 
Control are required for this course. However, the utilization rate for this 
course is just over 50 percent. Reducing the class size by one-half will re- 
duce the Instructor requirements for 509V by one-half also. Although this 
example points out the need to modify the SCRR model to include course utiliza- 
tion rate (a change that is currently planned for Phase III), it also demonstrates 
that all model results should be Interpreted and modified as required to account 
for simplification or assumptions built into the model. 

In addition to overstating requirements, the infeasibilities may also result 
from understating availabilities. Perhaps one or more Instructors have not 
been identified as available to instruct a course they are actually teaching, 
or individual Instructor availabilities may exceed the average figure of 1000 
hours per year currently assigned to all Instructors in the master data base. 

The existence of infeasibilities in the LP problem constraint equations does, 
however, facilitate the checking of several SCRR model software subroutines. 
The MPSX control language program did store the infeasible solution on disk 
storage and the output formatting program was able to interpret the stored in- 
feasible solution (which did not Include the sensitivity analyses results) and 
print only the LP solution results, leaving the sensitivity analysis results 
columns blank. 

Resources listed at 100 percent utilization in Figure 11-15 should not be 
Interpreted to mean that those resources are currently 100 percent utilized. 
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Since the objective of this problem formulation was to maximize student through- 
put, the resource data output represents the utilization that could be achieved 
If student throughput were maximized by establishing the number of course con- 
venlngs Indicated by the SCRR course data output. 

SCRR Output - Course Data. The SCRR course data output depicts the number of 
convenlngs for each course which would result in maximum student throughput 
subject to current resource limitations. In the event of an infeasible solu- 
tion, as is the case for scenario 1, the number of course convenlngs for those 
courses with insufficient resources is entered at the minimum requirement, 
even though sufficient resources to meet the requirement do not exist. Also, 
as with resource data, the sensitivity analysis results columns remain blank 
since no sensitivity analysis was pej formed. 

Figure 11-16 indicates that sufficient resources are available to convene course 
007E 6.2 times per year. Practically speaking, unless 0.2 convenlngs is inter- 
preted to represent a class which is convened but is only 20 percent complete 
at the end of the year, 6.2 convenlngs could be reduced to 6 convenlngs per year. 
This is 50 percent more than the presently scheduled 4 convenlngs per year. The 
formatted MPSX input (Figure 11-14) indicates that IGOOl and IG002 are both re- 
uired for course 007E. Referring to the Requirements Specification Listing 
Figure 11-10), we note that, in addition to 007E, IG002 also Instructs course 
347W. The optimal number of convenlngs for 347W is 16.7, which requires 668 
IG002 hours (16.7 convening x 40 hours per convening). IG002 has 332 hours 
(1000 minus 668) availability remaining to devote to course 007E, which at 54 
hours per convening, can be convened 6.2 times. IGOOl will utilize 556 hours 
(6.2 convenlngs x 90 hours per convening) of the total 1000 hour availability. 
The above calculations demonstrate that data base integrity is maintained 
throughout the entire SCRR model, from initial data base input through the 
specification listing and MPSX formatted input, to the final SCRR resource and 
course data outputs. 

The SCRR course data output for scenario 1 indicates that sufficient resources 
are available to convene course 007E 6.2 times per year, and course 347W 16.7 
times per year. The current number of convenlngs scheduled per year for both 
courses is 4. Both courses also have a student capacity of 4. Therefore, the 
current annual demand for these courses is 16. The SCRR output can be inter- 
preted several ways. First, sufficient resources currently exist to quadruple 
course 347W throughput. Unless course 347W demand quadruples, this infonnation 
Is not utilized. Second, since the number of convenlngs can be quadrupled, 
current resource utilization must be about 25 percent. This becomes extremely 
useful information. The additional available time (500 hours from course 347W 
alone) could be utilized for cross-training, assisting in other teaching duties, 
or performing other duties as required. 

General. 120K bytes was adequate space to execute the SCRR model for the total 
125 course data base. However, because of the infeasible constraint equations 
in scenario 1, the SCRR model was not run to completion (the sensitivity 
analysis was not performed). Scenario 2 will attempt to amend all infeasible 
constraints encountered in scenario 1, thus generating an optimal solution and 
the sensitivity analysis. The assessment of storage requirements will be 
discussed in conjunction with scenario 2. 
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SCENARIO 2 - MODIFY MASTER DATA BASE CONTENTS: EXECUTE SCRR MODEL USING 
SCRATCH DATA BASE INPUT. The objectives of the second scenario are to: 

a. Analyze scenario 1 output to determine the source of scenario 1 in- 
feasl bill ties. 

b. Create a scratch dat-^ base. 

c. Modify the scratch d&ta base to eliminate all infeasibilities. 

d. Execute the SCRR model to obtain an optimal solution and sensitivity 
analysis report. 

Scenario Input Data. For the purpose of this scenario, the data Infeasibilities 
will be eliminated by Increasing the availability of those resources for which 
requirements exceed availability, thus enabling the model to compute a sensitivity 
analysis report for illustrative purposes. As stated in the scenario 1 discussion, 
understatement of resource availability represents only one of several possible 
explanations. The data for all courses for which requirements exceed availability 
should be examined on an individual basis to ascertain the reason for the incon- 
sistency. Increasing availabilities to equal requi remt^nts is not Intended to 
represent a realistic solution to the problem. 

Using the SCRR resource data output (Figure 11-15) and the Requirements Speci- 
fication Listing (Figure 11-10) from scenario 1, the data base modifications 
required to eliminate the data inconsistencies can be detennlned. For example, 
IG004 availability 1s 3958 hours less than stated requirements. Figure 11-10 
Indicates that Instructors 137 and 140 make up IG004. Increasing the avail- 
ability of each of these instructors to 2979 hours per year (one-half of the 
instructor group minimum requirement) will eliminate the 16004 infeaslbil ity. 
Similarly, IG005 availability is 446 hours less than requirements. Increasing 
the availability of Instructor 142 to 1446 hours will correct this inconsistency. 
The same procedure was followed for all negative entries in the "hours under 
utilized" column. The availabilities of 24 instructor groups, which Include a 
total of 78 Instructors, were modified following this technique. 

The master data base should not be modified until the data base audit has been 
completed and the true causes for the data inconsistencies have been identified. 
Therefore, a scratch data base was created. Modifications can be made to the 
scratch data base while the master data base Is left intact. To create a scratch 
data base* the user need only select the appropriate Job Control Language (JCL) 
card deck (see SCRR model operating procedures. Volume III, Section II). To 
make the required modifications, the user should use the Instructor File Load/ 
Change Form (Figure 11-17), making entries only in those columns for which 
changes are required. To change the availability of instructor 137 from the 
current 1000 hours to 2797 hours, a "C" is entered in column 1 of the change 
form to indicate that the entry represents a change; the instructor number is 
entered in columns 2-4, and the new availability is entered In columns 43-47. 
The data base course file can be updated using the course file change forms 
which are discussed in the data base section (Volume III, Section Vj. 

Processing the JCL to execute the SCRR model, indicating the scratch data base 
as the data source, completes the Input data requirements for scenario 2. 
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Special Run Conditions. Scenario 2 will formally test the following SCRR model 
software routines which were not exercised In scenario 1: 

a. Scratch data base creation. 

b. Data base modification. 

c. MPSX sensitivity analysis. 

d. Sensitivity analyses output formatting. 

iHl Output. The entire 125 course data base could not be processed by the 
SCRR model software because of insufficient storage availability on the computer 
used for mode] development. The problem occurred during the execution of the 
MPSX sensitivity analysis, since MPSX source code was not available, Internal 
storage allocations could not be modified. However, the ability to process all 
fS^'^fSL^" simultaneously Is not essential to the operation of 

tne SCRR model. The user has the capability to select, by school, which courses 

5« copied from the master DOTS data base to the scratch data base. The 
SCRR model results will be identical whether the model Is run for a single 
scnool or for all schools, since each school's resources are Independent; i.e., 
instructors and classroom space are not shared between schools. Interdepen- 
dencies do not cross school lines. 

To obtain the final results for scenario 2, the SCRR model was run four times. 
A scratch data base consisting of courses from one to five schools was created 
for ;«ch run. It was not necessary to recreate the instructor file in the 
scratch data base for each run. Excerpts from scenario 2 SCRR results, includ- 
ing the sensitivity analysis, are presented in Figures 11-18, 11-19, and II-20. 
Computations similar to those described in the scenario 1 discussion were made 
to verify the accuracy of the model results. 

5fif555i2.? " 'DEALLOCATE IT/AD SCHOOL RESOURCES TO MEET PRESENT TRAINING RE- 
QUIREMENTS. This scenario is presented to demonstrate the utility of the SCRR 
model in the analyses and solution of a typical management problem. The ob- 
jective of the scenario is to present a problem-solving technique rather than 
to generate a solution to an existing problem. 

The IT/AD school courses were selected from the master data base to form a 
scratch data base containing only IT/ AD school courses. The SCRR model was 
executed using this scratch data base as input. The results of this model 
run are presented In Figures 11-21, 11-22, and 11-23. The SCRR resource data 
output (Figure 11-22; Indicates two instructor groups for which requirements 
exceed availability. 

IG002 consists of 12 instructors who teach only the Basic Instructor Training 
course (COP - 3400). Assuming that the Instructor requirements listed for 

•«S2!i"* correct, an additional 4320 hours per year must be allocated 
to IG002. The first step Is to examine the contact hour availability of each 
Instructor In 16002 (see Figure 11-21). Since the course material for course 
3400 Is relatively static, the course instructor's contact hour availability 
should be greater than average. For the purpose of this analysis, we will 

availability of each instructor In IG002 should be increased 
to 1100 hours. Since this adjustment still leaves IG002 total availability 
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more than 3000 hours short of the course requirement, further adjustments 
will have to be made. 

The next step is to examine course utilization, which for course 3400 averages 
about 85 percent. Considering course utilization, the actual class size is 
approximately 25 rather than the listed capacity of 30 students. Referring to 
the data base listing for 3400 (Figure 11-24), it is noted that 27.0 hours are 
required with a 5:1 student/instructor ratio. Taking the utilization into 
account reduces the instructor requirement from 6 to 5 for that portion of the 
course. The annual requirement for the course can be reduced by 1296 hours 
(27 hours per convening x 48 convenings per year). 

Initial analysis has resulted in increasing the availability of IG002 by 1200 
hours and decreasing course 3400 annual requirement by 1296 hours. The next 
step Is to examine the resource-requirement relationship of other IT/AD school 
courses. Figure 11-23 indicates that courses 536M. 536Q. and 9410 have 
sufficient resources available to more than double the number of annual con- 
vohlngs. Since the utilization for these courses averages 45, 65, and 75 per- 
cent respectively. It seems reasonable to assume that the demand for these 
courses will not double in the near future. This assumption allows us to 
recalculate the requirements for these courses based on current scheduled 
convenings. 

Course 536M instructor requirements drop to 40 hours per convening when the 
calculation is based on average class size rather than class capacity. The 
total annual requirement for 536M becomes 960 hours (40 hours per convening 
X 24 convenings per year). IG006 (see Figure 11-21) also instructs course 
536L. The annual requirement for 536L Is 1392 hours (58 hours per convening 
x 24 convenings per year). Summing the requirements for 536L and 536M, 
IG006 minimum total requirements become 2352 hours per year. Current IG0U6 
availability Is equal to 5000 hours per year. From the Instructor file 
listing. It Is noted that Instructor 53 will be rotated within two months. 
Instructor 54 (a random selection from four remaining IG006 Instructors) 
will be assigned to course 3400. 

Course 536Q has a minimum annual requirement of 900 hours (36 hours per con- 
vening X 25 convenings per year). IG007 teaches only course 536Q and has a 
total annual availability of 4000 hours (Figure 11-21). Since 536Q has a 
requirement for two Instructors for one-half day of the one week course, 
IG007 win be reduced to two Instructors with a total availability of 2000 
hours (still double the minimum requirement). Instructor 48 will be reas- 
signed to course 3400. Instructor 49 will be reassigned to course 3691. 

Returning to Figure 11-22, the second resource for which availability is 
less than total requirements Is IG004. IG004 consists of two Instructors, 
38 and 39. A check of the Instructor file listing shows that instructor 
' 39 Is scheduled to be rotated within the next two weeks. Therefore, 
Instructor 39 will be removed from the course file; he will be replaced 
by Instructor 49 who will be reassigned from course 536Q. 

Course 3691 has a class capacity of 16, but an average utilization of 35 per- 
cent. Therefore, the average class size for this course will be adjusted 
to 6 per convening. Course 3691 has a 4:1 student/instructor ratio for 48.0 
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hours of lab instruction (Figure 11-25). Based on a class capacity of 16, 
a total of four instructors is required for the lab period. However, this 
requirement is reduced to two instructors when the course utilization is 
considered. Recalculating the instructor requirement for course 3691 , based 
on a course utilization of 35 percent reduces the requirement per convening 
from 234 hours to 138 hours (1 instructor x 39 hours + 2 instructors x 48 
hours + 1 instructor x 3 hours). 

Course 9498 is also instructed by IG004. Based on an average utilization rate 
of 5 percent, the instructor requirement per convening can be reduced from 57 
hours to 30 hours. The number of course convenings shouU also be decreased 
from 4 to 1 time per year. 

The data modifications suggested by the preceding analysis will ensure that 
all IT/AD school resource availabilities are greater than or equal to their 
requirements. It is fully admitted that some of the assumptions which were 
Included in the analysis may be unrealistic; and that the personnel trans- 
fers which were indicated may not be feasible. However, as was pointed out 
earlier, the objective of this scenario is not to solve an existing real- 
world problem, but to demonstrate how the SCRR model data might be used to 
solve such a problem. 

Scenario Input Data . The data modifications resulting from the preceding 
analysis are summarized below. These changes were made to the scratch data 
base, both the course and the instructor file. The SCRR model was then rerun 
against the updated scratch data base. 

a. All members of IG002 - increase availability to HOC hours. 

b. Delete instructor 048 from 536Q; add instructor 048 to course 
3400; instructor 048 availability = 1100. 

c. Delete instructor 054 from 536M; add instructor 054 to course 
3400; instructor 054 availability = 1100. 

d. Course 3400 - decrease instructor requirement to account for 
utilization rate. 

e. Delete Instructor 039 from 3691. 

f. Delete instructor 049 from 536Q; add Instructor 049 to course 
3691. 

g. Course 3691 - decrease instructor requirement to account for 
utilization rate. 

h. Course 9498 - decrease instructor requirement to account for 
utilization rate. 

i. Course 9498 - decrease number of annual convenings. 

Special Run Condition . The SCRR model was executed using. the updated scratch 
data base previously described as Input data. 
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Design Criterion Tested . Scenario 3 required a management analysis of an 
Initial SCRR model run. The scratch data base was then modified and the 
SCRR model rerun to verify that the modification produced the desired effect. 
An Important operational feature of the SCRR model is the ability to easily 
and quickly modify the input data and rerun the model. 

Test Run Output . The results of Implementing the suggested modifications 
can be easily assessed from the SCRR model output presented in Figures II- 
26. 27. and 26. 

SCENARIO 4 - PERFORM INSTRUCTOR AVAILABILITY PARAMETRIC ANALYSIS. The ob- 
jectlve of this scenario is to present an information-oriented application 
of the SCRR model, as opposed to the problem-solving application demonstrated 
by scenario 3. f'erhaps the most significant variable considered in the SCRR 
model is Instructor availability. Instructor availability is defined as the 
number of hours per year an Instructor is available for classroom instruction. 
Specification of availability is meaningless unless a requirement to utilize 
the available time can be identified. All course descriptions identify very 
specific Instructor contact hour requirements. The problem we are faced with 
Is that although contact hour requirements are very specific, contact hour 
availability has been difficult to evaluate. Several attempts have been made 
to set standards for contact hour availability, but because of the high vari- 
ability in requirements of activities outside the classroom, these standards 
have met with little acceptance. 

Each Instructor entry in the master DOTS instructor file has an availability 
figure associated with it. Initially, all availabilities were set equal to 
1000 hours per year (1000 hours represents an approximate average of exist- 
ing availability standards). The ultimate goal, of the data base is to 
establish availability on an individual basis. Availability, although 
tailored to the individual, will be a function of, the set of jobs the indi- 
vidual is responsible for performing. 

A parametric study of availability can achieve two objectives: 

a. The total Impact of Instructor availability on the training 
complex capabilities will be dramatically demonstrated. 

b. The study can help to establish some acceptable limits of 
Instructor availability within which the training complex 
can operate effectively. 

Scenari o I npu t Data . To limit the data input requirements as well as the 
volume of model output, the parametric study 1s limited to a single school. 
The courses for the ASW school are first transferred to the scratch data 
base along with the Instructor file contents. The availabilities of the 
14 ASW Instructors are initially set equal to 700 hours per year. The SCRR 
model is run using the scratch data base as input. Instructor availabilities 
are Increased In Increments of 100 hours per year to a total of 1200 hours. 
Each change requires only a simple modification of the scratch data base 
Instructor file. The course file does not have to be modified. The SCRR 
model Is executed after each instructor file update. 
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FIGURE 11-32 SCENARIO 4 - SCRR RESOURCE DATA OUTPUT - 1000 HOURS AVAILABILITY 
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SECTION III 



EDUCATIONAL TECHNOLOGY EVALUATION MODEL 



MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS 

With the increasing emphasis on self-paced, individualized instruction in 
naval training, there is a requirement for a method for predicting the resources 
necessary to support individualized instruction and for evaluating different 
types of administration for such systems. 

The Educational Technology Evaluation (ETE) model is a generalized, discrete 
simulation model designed to simulate the flow of students through an Individ- 
ualized Learning System (ILS). Its purpose is to permit simulation of a variety 
of ILS configurations, student flows, and course strategies by manipulation of 
input data alone rather than by modification of the model itself. It is the 
generality of the model that is the key factor in its design. 

The ETE model is not intended for use in evaluating educational media or tech- 
niques with regard to training effectiveness. It is designed to evaluate the 
effectiveness of different strategies (e.g., computer managed instruction or 
Instructor managed instruction), with regard to throughput and resource utiliza- 
tion efficiency. Given curricula and media descriptions, an estimate of the 
input rate for different student types, and an inventory of available in- 
structors, learning modules, and facilities, the ETE model will project system 
output, average time-to-complete, and instructor and facility utilization. 

The primary problem arising in the design of a generalized simulation model 
lies in balancing model capability with ease of use. Theoretically, it is 
possible least to approximate every combination of events and resource usage 
that the analyst can envision. However, every additional level of complexity 
which exists internal to the model demands, at a minimum, a control or selec- 
tion type input. Si»Ke all inputs must be specified by the user, the complexity 
of input data rises as a direct function of the level of detail contained in the 
model. Consequently, models that contain highly detailed representations of 
internal system activities may require input data so complex as to discourage 
the potential user. 

One way to avoid this problem is to construct simulation models which are 
tailored to a particular system or activity. Such models can contain explicit 
and complex mechanizations which do not require extensive input data for 
support. On the other hand, highly specific models are rarely applicable to 
other systems without revision. The disadvantages of constructing a new model 
for each system configuration to be simulated include: delays in constructing 
and testing the models, a continuing need for qualified personnel to construct 
the models; and constantly changing input requirements imposed on the mode 
users. 

ASSUMPTIONS NECESSARY FOR GENERALITY. In order to model certain aspects of 
an ILS without tailoring the model to a specific system, it is necessary to 
assume that generalized representations can be made which are applicable in 
a number of cases. In general, these assumptions center around criteria for 
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deciding when certain activities are required and the activity patterns for 
certain facilities. 

Some areas which present difficulties in generalized ropresentation are: (1) 
instructor/student interaction; (2) remedial activities involving instructional 
matter in a different medium; (3) conditional branching within a course of 
instruction; and (4) preemption of facilities by students designated as 
having priority over other students. Detailed information on the particular 
methods used to model each of these activities, or the rat-'onale for exclusion 
of a particular form of simulated activity, can be found m Section III, Logic 
Design. 

There are other activities which are so basic to the operation of an ILS that 
their inclusion in the model is mandatory. These include: 

a. A single course, or multiple courses. 

b. Different media characteristics specified by module. 

c. Individual and team training modules. 

d. Instructors assigned by qualifications and responsible for specific 
modules. 

e. Remediation activities, including probability of occurrence and re- 
quired support. 

The basic technique used to achieve generality of application was to designate 
all student activities, whether learning or administrative, as "modules." 
Each of these modules is tagged with an identification code which designates 
the type of support required for that module. Since all parts of the ILS, ex- 
cludingt|ift students, can be thought of as resources to be used in support of 
the jBftOdentl contention between students and the demand level for each type 
of n^sourcfJtyOT^ the basic content of the model. For example, the student 
s1gn-tTrpro|edt)i« referenced in Figure III-l can be represented as a module 
which every'student must complete first, and which requires the support of 
ancillary personnel. By following this approach, the user can simulate 
different administrative procedures without supplying data in a multitude of 
forms. The use of module code numbers is explained beginning on page II 1-7. 

The ETE model was written using the General Purpose Simulation System (GPSS)^ 
which consists of a high level simulation language, the language compiler, 
and a model execution control program. Although GPSS designates a specific 
IBM-developed program package, other versions have been developed by other 
manufacturers and include the GPS K (Honeywell) and Flow Simulator (RCA). 
Both Univac and Control Data Corporation also have GPSS compilers . 

As might be expected, GPSS has certain characteristics and limits as to model 
execution time and model size. These characteristics did not impact model 
design to any significant extent but do carry implications regarding model 
usage. These implications are discussed on page I 11-31, Validation Results. 

*»6PSS Primer, Stanley Greenberg 
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INPUT PARAMtTERS DESCRIPTION 

In general, inputs are required to define the learning system configura- 
tion; i.e., curricula, number of instructors, module completion times, etc., 
of the courses being simulated. This section is divided into two parts. The 
first part describes each of the required input parameters. The second part 
defines the required format of the input data. It should be noted that the 
format specified applies to the model as it currently exists. A simplified 
input format will be generated during Phase III. The method for insertion of 
the formatted input data in the model is covered in Volume III of the report. 

REQUIRED INPUT DATA. Listed below are the parameters required to formulate an 
ILS model. 

a. Rate of student input. 

b. Number of student types and distribution - Student type is directly 
related to the curriculum to be followed by that student. Student 
distribution is the percent of all incoming students assigned to 
each type. 

c. Curricula - A curriculum, which consists of the sequence of module 
numbers to be completed by the student, must be supplied for each 
student type. For example: 

Student type I: Modules 1, 3, 6, 7, 9 and 11. 
Student type II: Modules 2, 3, 4, 5, 7, 8 and 9. 

d. Module type code - Each module must be assigned a code number between 
0 and 31. This code number describes the support requirements for the 
module (e.g., instructor required, other equipment, etc.), over and 
above the availability of the module itself. 

e. Instructor qualifications - Available instructors are grouped accord- 
ing to the modules they are qualified to teach. For example, modules 
1-4 may be assigned to instructor group I, modules 5-10 to instructor 
group II, etc. 

f. Number of instructors - The number of instructors in each instructor 
group must be specified. 

g. Available modules - The number of copies of the instructional matter 
for each module must be specified. For example, if module number 3 
is a video tape cassette, the number of cassettes in the inventory is 
supplied here. 

h. Number of students per team - If any of the modules in a course re- 
quire .a team of students, the number of team members is specified 
here. 

i. Remedial modules - Where a module is designated as having remedial 
matter which is not self-contained, a corresponding remedial module 
type must be designated. 
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j. Number of remedial modules - The number of available remedial modules 
of each type must be specified In the same way as the primary modules. 

k. Projected completion times - Each module, both primary and remedial, 
must have an estimate of time-to-complete. 

1. Completion spread - The completion time (Item k.) for each module may 
be modified by a spread value. For example, If the projected time- 
to-complete for a given module Is two hours, the factor may be 
modified by a spread so that completion time becomes two hours plus 
or minus thirty minutes. If no spread Is supplied, a zero value Is 
assumed. 

m. Available facilities - Where other facilities (such as carrels or 
power supplies) are required for completion of a particular module, 
the number of available facilities must be specified. 

Care must be exercised In supplying consistent Input data. If, for example, 
seven different student types are defined, seven curricula must also be de- 
fined. Otherwise* an execution error will result. 

Required Input Data Format . With the exception of the student Input rate, all 
required input data are in the form of tables. These tables all have similar 
formats consisting of a single table definition card, called a FUNCTION card, 
and ds many additional cards as are needed to supply the required entries to 
fill the table. 

Curriculum tables are designated by number (1 through n, where n Is the same 
as the number of student types), all other tables are designated by alphabetic 
mnemonics. The easiest way to describe the required Input formats Is to define 
a hypothetical ILS which is to be modeled, and then to describe the tables re- 
quired to define this system. 

The hypothetical system has the following characterl sties : 

a. Three types of students. 

b. A maximum of eight Instructional modules. 

c. Two groups of Instructors; group 1 qualified to teach modules 1-4, 
group 2 qualified to teach modules 5-8. There will be three In- 
structors In each group. 

d. Modules 5 and 6 are team modules requiring two students and four 
students respectively. 

e. The three student types are distributed as follows: 30% type I; 
45% type II; and 25% type III. 

Other system characteristics will be discussed In connection with the construc- 
tion of the apn*»opr1ate table. 

Figure III-2 shows the required card layout for all of the Inputs required for 
the hypothetical ILS. Each of the card types will be discussed as they appear 
In the figure. 
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Curriculum Cards. The fomat of these cards as regards card columns, and 
the use of commas and slashes as separators, is the same for all table entries 
and need be discussed only once. 

The first curriculum card defines the number of the curriculum (card column 2). 
The word FUNCTION always appears in card columns 8-15 as does P9 in card 
columns 19-20. The symbol L4 in card columns 22-23 specifies the length 
(number of modules) of the curriculum. For other curricula, only the curricu- 
lum number and the number of modules will change. 

The second curriculum card specifies the module number that corresponds to each 
step in that particular curriculum. If more than one card is required to de- 
fine a curriculum, the card layout is always the same. Entries always begin 
in column 1 and there are no blank spaces in the body of the input data. 

Each pair of numbers; e.g., 1, 2, designate first the step number and then its 
associated module number. The slashes serve to separate the pairs of values. 
The number of pairs of values must equal the curriculum length specified in 
the first curriculum card. 

In the example given in Figure III-2, the first two curriculum cards contain 
•the following specifications: 

a. Curriculum number is 1. 

b. Curriculum length is 4 modules. 

c. The curriculum consists of modules 1, 3, 4, and 5, in that order. 

Module Type Cards. Module type cards are used to relate the module type code 
with the modulfe number. The type code designates the support requirements for 
the particular module. Table III-l lists 31 type codes and shows the require- 
ments specified by each type code. A type code of zero is also permissible 
and designates a module with no outside support requirements (a programmed in- 
struction manual would be a type zero module). 

The first module type card has the same format as the first curriculum card, 
except that the function is designated by the mnemonic MOOT instead of a 
number. Note that the length designator (column 23) equals 8, the number of 
modules available for the course. Every module specified for a course must 
have a corresponding module type code. 

The second and subsequent module type cards follow the same format as comparable 
curriculum cards. The first digit of each pair designates the module number 
and the second module type. 

In the example given, the first module type code specifies a module requiring 
instructor assistance and facilities such as a video tape player (see Table 
UI-1). The second type code designates a module requiring instructor assis- 
tance and one in which remedial matter is not self-contained. Note that 
modules 5 and 6 both have codes which identify them as group modules per the 
problem statement. 
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MODULE TYPE CODE DEFINITIONS 
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TYPE 


REQUIREMENT 
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INSTRUCTOR 


16 
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GROUP 


17 


INSTRUCTOR, RFt^ j 


«j 


INSTRUCTORt GROUP 


18 


GROUP, REM 
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STAFF 


1? 


INSTRUCTOR, GROUP, REM 




INSTRUCTOR. STAFF 


20 


STAFF, REM 
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GROUP. STAFF 


21 


INSTRUCTOR, STAFF, REM 
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INSTRUCTOR. GROUP. STAFF 


22 


GROUP, STAFF, REM 
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FACILITIES (FACIL) 


23 


INSTRUCTOR, GROUP, STAFF, REM 


II 


TM^TBlirTQR FACIL 
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FACILITIES, REM 


10 


uRUUrt rMViU 


25 


INSTRUCTOR, FACIL, REM 


11 


INSTRUCTOR, GROUP, FACIL 


26 


GROUP, FACIL, REM 


12 


STAFF, FACIL 


27 


INSTRUCTOR, GROUP, FACIL, REM 


13 


INSTRUCTOR, STAFF, FACIL 


28 


STAFF, FACIL, REM 


14 


GROUP, STAFF, FACIL 


29 


INSTRUCTOR, STAFF, FACIL, REM 


15 


INSTRUCTOR, GROUP, STAFF, 


30 


GROUP, STAFF, FACIL, REM 




FACIL 


31 


INSTRUCTOR, GROUP, STAFF, FACIL, RB< 
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Completion Time Cards. Completion time cards are used to specify the average 
expected completion time for each module. Time is stated as an Integer number 
representing the number of times the internal model clock will tick before 
the module is completed. The user must relate the internal clock to external 
time by deciding what period of real-time is represented by each tick of the 
internal clock. For example, if each tick of the internal clock represents 
one half-hour of external tim-, then a module whose expected average completion 
time is two hours would be given a completion time of 4. The user must take 
care to maintain consistency in using the internal clock. Student input to 
the system is also governed by the internal clock and the same ratio of internal 
to external time must be maintained for student input as for module completion 
time. 

The first completion time card is identical in format to the first module type 
card except for the acronym change. 

The second completion time card is similar in format to the second module type 
card and, in the example, specifies module 1 as requiring 6 Internal time in- 
crements, module 2 as requiring 9, and so forth. 

Completion Time Variation Cards. Each module, in addition to the average time 
to complete, can also have a range of variation around the average. When 
specified, the range causes the average completion time to be modified so that 
completion times range between the average miiius a specified delta, and the 
average plus that same delta. The completion time is modified on a random 
basis so the average completion time, over a sufficient sample, remains as 
specified, but individual completion times can vary between the limits set by 
these cards. 

The format of these cards is the same as those for the completion time cards. 
The example given in Figure III-2 would yield a completion range for modu e 1 
of 6 + 2 internal clock increments. The completion time variation must always 
be equal to, or less than, completion time Itself. 

Instructors and Modul'^i. Before discussing the Input cards which govern the 
availability of instru tors, modules, remedial modules, etc., it is necessary 
to explain the way in which the modei handles these different entities. 

With the exception of "Other Facilities" (which are discussed later in this 
section), all resources for which the student may contend, are considered by 
the model to be a single table of resources. It is the position within the 
table that identifies the type of resource under consideration. The user 
specifies which type of resource occupies a particular area of the resource 
table and the number of resource Items available. 

For example, in a table of 200 resource units positions, I'^Z might set 
aside for Instructors, 13-150 for instructional modules, and 151-200 for 
remedial modules. ^ 

In the example system under consideration, there are to be two Instructor 
groups. If each instructor group has a maximum of three instructors, then the 
maximum number of instructors will be six. Conseguently , positions 1-5 in 
the resource table are set aside for Instructors (in practice, it is a good 
Idea to allow a margin for change in case the Initial estimate of a maximum 
turns out to be too low). 
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Instructor Assignment Cards. This function carries the mnemonic INSTT and the 
Cord formats are the same as those previously discussed. In the second (and 
subsequent) instructor assignment card, the first of each pair of numbers is 
the module number and the second shows the assigned position of the first in- 
structor in the group within the resource table. Note that modules 1-4 all 
point to position 3 in the resource table and 5-8 all point to position 6. 
This coincides with the requirement that there be two instructor groups quali- 
fied to handle mod-jles 1-4 and 5-8, respectively. 

Instructor Qualification Cards. These cards define the number of members in 
each instructor group and are designated INSTN. As the second card indicates, 
the number of qualified instructors is specified for each module. In this way, 
it is possible to simulate instructor groups in which all members are not i 
qualified to teach all modules. 

Module Location and Inventory Cards. These two tables (MODFL and MODN) perform 
exactly the same function with respect to modules as INSTT and INSTN do for 
Instructor's. The first function (MODFL) specifies the resource table location 
of the module and the second (MODN) specifies the number of available modules. 

Remedial Module Type Cards. Remedial modules are treated in the same fashion 
as regular instruction modules, excepw that the module number referred to is 
that of the primary module^, so a function to supply the module number is not 
needed. MOOR supplies a type code for each remedial module, MODRL locates the 
module in the resource table, and MODRN carries the available module inventory. 

Other Facilities Assignment Cards. As previously mentioned, other facilities • 

are not included in the table of resources. They occupy their own table, but 

the method for relating module number to resource group is the same as that 

for any other resource. Similar facilities, such as carrels or terminals, are 

arranged in groups and a module requiring these facilities is related to the ' 

group number of the appropriate facility. 

The other facilities function is called FACT and its fomat is the same as other 
tables in this series. In the example, modules 1 and 5 are associated with 
facilities groups 1 and 2, respectively. Modules which do not require other 
facilities have a zero entry in the facilities group number. 

Student Distribution Cards. Both the first card and the subsequent cards in 
this group differ in format fr-om those discussed so far. The first card can 
be reproduced one for one with the example, except that the digit following 
the letter D must equal the number of pairs of arguments appearing in the 
following cards. 

Team Definition Cards. Like the module type cards and the completion time 
cards, the team definition cards rel^ite module number to a particular rrodule 
attribute. In this case, the attribute in question is the number of members 
required for a team-type module. The card format is the same as that of MODT» 
TYME, and several other functions. » 

The Illustration in Figure III-2 allocates two team members to module five, and 
four to module six. Again, note that the modules specified correspond to 
those designated by the module type code as being team modules. In the event 
of erroneous data entry causing a team to have zero members, the model will 
still process a single individual in place of that team. 
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The second card differs from those previously discussud in that the first 
number of each pair is no longer an integer but a decimal fraction. Each 
decimal fraction represents the cumulative total of percentages for each 
student type. In the example, the first decimal fraction (.30) corresponds 
to the stated requirement that 30% of the input students are type I. The 
next argument (.75) is the total of 30% for type I and 45/^ for type II. 

Other Facilities Inventory Cards. As noted, other facilities are not included 
in the standard resources table. This difference is also evident in the cards 
required to define the facilities inventory. All inventory cards have the 
same format (there is no difference between the first and subsequent cards). 
In each pair of arguments, the first argument, Sn, designates the facilities 
group (SI is group 1, S2 group 2, etc.). The second number in the pair is the 
number of items available in that group. In the example, group 1 has 50 
Items, group 2 has 75. As many different types of facilities may be defined 
as are required. ^ 

OUTPUT PARAMETERS DESCRIPTION 

6PSS provides certain standard outputs which are described in this section 
Three additional outputs have been programmed into the ETE model. Others can 
be added as operational need dictates. 

An alternate output format is available which yields the same data as the 
standard package, but with labels which are specific to ILS. 

STANDARD OUTPUTS. Thr standard GPSS outputs include the following: 

a. Facility utilization - Facility, in this sense, is a general term 
covering instructors, learning modules, and support facilities. In 
all cases, number of students using, average time of use, and per- 
cent utilization are given. 

b. Queue statistics - Whenever a student is required to wait for any 
reason, whether for group formation or instructor availability, 
certain statistics are gathered by the model. These Include: 

^ Maximum queue length 

t Average queue length 

Total student entries In the queue 

Average waiting time. 

c. Entry counts - These statistics indicate the number of students who 
pass through each part of the system. While primarily useful In 
logic validation, they can also indicate unsuspected paths through 
the system and point to potential overload conditions. 

d. Additional outputs - Average time- to-complete: the av. rage time-to- 
complete for each student type is computed and output. Number of 
completions: the number of student completions, arranged by student 
type, is supplied. 

The format for the standard output is Illustrated in Figure III-3. In the 
standard format, none of the facilities or queues are identified by number. 
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The user, in the process of specifying the number of iFistructors , modules, etc., 
during input preparation (see page III-5), automatically selects the range of 
numbers which designate those facilities which represent in?;tructors , modules, 
etc. Queue numbers and facility numbers correspond; i.e., if facilities 105- 
110 are designated as representing a group of six Instructors, the queues lOS- 
110 represent the waiting lines for those instructors. 

ALTERNATE OUTPUT. In the alternate output format, the output data described in 
the preceding paragraphs are broken out and labeled according to their specific 
function. Facilities utilization data are output as "Instructor Utilization," 
"Module Utilization," and "Other Facilities Utilization." 

Queue statistics are output as "Time Waiting for Instructor" and "Time Waiting 
for Module." 

Student statistics are output in motrix form with student type designating the 
columns and number of students completing and average completion time comprising 
the two rows. 

Figure III-4 illustrates the alternate output format. 
LOGIC DESIGN 

The purpose of the ETE model is to project the performance of Individualized 
Learning Systems (ILS) using different administrative practices and various 
combinations of Instructors, curricula, and resources. 

MODEL TECHNIQUt SELECTION. Certain aspects of the problem addressed preclude 
the use of some analysis techniques but lend themselves to others. Since the 
systems to be investigated, in many cases do not yet exist and empirical 
historical data are nonexistent, mathematical analysis to identify relation- 
ships between variables is not possible. Similarly, optimization where the 
relationships between variables are not known to be linear is also unattractive. 

For these reasons, some fom of simulation appeared to be the most reasonable 
approach. Given that simulation 'of proposed ILS was to be attempted, it re- 
mained to choose between continuous flow and entity type simulation. Contin- 
uous flow implies that a deterministic approach can be taken, at least inso- 
far as simulation of student flow through parts of the system is concerned. 
Even wl ore branches within the flow are simulated by probabilistic means, the 
flow between branches must still be approximated based on some form of re- 
lationship, either historical or assumed. 

Inasmuch as most of the ILS to be simulated will consist of a set of assumptions 
on the part of the course designer, the combination of an assumed course con- 
figuration plus assumed flow characteristics is not likely to produce results 
upon which design decisions can be based. If ILS were common within the 
naval training system and historical data plentiful, tl,e ETE model might well 
have taken the form of a deterministic flow simulation. 

Where the system can be defined in terms of available resources and course 
steps, and the system to be .simulated consists of a course, or courses, with a 
limited number of students on board at any one time, entity flow constitutes 
a viable technique. 
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Ihu avL'raqo-on-bucird fur the course or school being si; jiated is probably 
tho key var'ahle in deciding whether entity flow is applicable to a particular 
class of |i»oblGin',. Roqardless of the complexity of the model itself, each 
entity (sr.udcnl.) active in the system requires memory space to track status, 
position m the logic flow, etc. As the AOB grows, the demand for computer 
memory grows and the execution time required to scan the status of all students 
increases. Lvontually, the computer system itself will place a limit on the 
number of '.tudcntT> that can be processed. 

The results to be derived from the sirulation also bear on the selection of 
the technique for simulation. If, for example, the only parameter of interest 
was the output of a collection of courses over time, then some form of 
deterministic model could be postulated which would produce estimates of sys- 
tem performance. If, however, the course designer wishes to derive estimates 
of the effect of individual parameters within the system (such as the number 
of instructors available to teach a particular course), then such a highly 
aggregated pproach would not be useful. Therefore, since the ETE model is 
intended for initial use as a course design tool, a discrete entity simula- 
tion approach was selected. 

IMPLICATIOiiS OF ENTITY FLOW SIMULATION. It is implicit in the selection of 
entity flow simulation such as tiie ETE modeling technique, that the events 
which take place as the student passes through the system can be described 
quantitatively. That i<i: (1) the student must follow a path whose logic is 
definable; (2") the student must obtain resources and use them for a specified 
length of time; and (3) the resources used must be grouped according to a 
defined taxor.on\y. 

Logic D ata Definition. It is quite likely that in a true ILS, students may 
branch to certaTfTtno Jules based on their performance on previous modules. 
This workL both for remedial matter and for matter by-passed because of pre- 
testing or a higher than normal score. In any event, since the type (i.e., 
level )'of student input to the system is not predictable, these conditional 
branches must be handled in such a way that the pattern of students branching 
or not branchinci is random. This random branching should be constrainable by 
a percontago factor so that, for example, 60SK of the students branch one way 
and 40"/ the other. 

The most "Straight forward way to build this capability into the model would be 
to inclnd" ronriitional brinches in line with model logic. However, as pre- 
<^iously stated (Model Description and Functional Specifications), the design 
goal of the ETE model v/as to produce a generalized entity flow model. 

Inclusion of explicit conditional branches would reduce the generality of the 
model and require the user to be familiar with the internal logic of the model. 
The ETE model addresses the problem of conditional branches by having the user 
specify an exact (by percentage) distribution of student types and the cur- 
ricula they follow. Where conditional branches exist in a curriculum, the 
user specifies two or more curricula (one representing each path) and applies 
any percentage constraint to the distribution of input students by type. 

Thi'i approach increases the volume 'n't not the logical complexity of the input 
data, and maintains the generality of ttie model. 
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Resource Grouping . The resources used by the student can be divided into two 
bdsic categories: those which he obtains from a central store and keeps with 
him (such as lesspn plans or manuals); and those which ho uses in serial fashion 
with other students. In this context, there is no difference between an in- 
structor and other training equipment. 

At first glance it might seem that there is a great deal of difference between 
an instructor and a video tape player. However, from a quantitative, logical 
standpoint they are similar. The student either has access to the instructor 
(or the tape player) or he waits. Once he obtains use of the resource, he 
occupies it fully until finished, at which time the resource becomes available 
to others. There is one major difference between the instructor and any other 
resource - the instructor is assumed not to be required for the complete dura- 
tion of the module (as would be the case with an equipment-type resource). 
The length of time for which the instructor is occupied (when required) is 
calculated on a stochastic basis and is discussed later in this section under 
Model Assumptions. 

Equipment- type resources might also seem to require complex modeling treatment 
because of the variety of types of equipment and training media available. How- 
ever, these differences are of more concern to the course designer during the 
media selection phase than during the phase in which the course is simulated 
for over-all perfomance. There may be a significant difference in the train- 
ing effectiveness or training objectives of a recognition study card set and a 
game study card set, but these differences are not quantitative from a simula- 
tion standpoint. As far as the ETE model is concerned each is a portable re- 
source which is either available or not available. 

Equipment- type resources do have some differences which are of consequence in 
use of the model. For example, there is a difference in the user approach to 
a lesson available only via a computer terminal and one recorded on video tape. 
The model considers each module to have two possible levels of equipment re- 
quirements designated as the "module" itself and "other facilities." In the 
case of the computer terminal lesson, the terminal becomes the "module" even 
though that same terminal might give access to a number of different lessons. 
The telephone line linking the terminal to the computer and the computer it- 
self are considered together as "other facilities." 

The video tape lesson is handled as follows: the video tape is the "module" 
and the video unit itself is "other facilities." 

As can be seen from the foregoing, the quantitative description of different 
modules is the responsibility of the user. After analyzing each module, the 
user can describe them logically by means of the type codes outlined under 
Input Parameters Description In this section. 

SOURCE LANGUAGE SELECTION. Considering the languages available for the com- 
puter system to be used for model development, the choice of source language 
resolved itself to using either the General Purpose Simulation System (GPSS) 
or another high level language such as FORTRA.N or PLl. 

GPSS is a high level programming language designed for developing entity flow 
simulation models. It consists of a language translator and the control and 
outpu"' programs necessary to support model execution. This combination of 
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programs ».v»nb1es the modeler to implement a model in much loss time than it 
would take to develop a model of the same level of complexity in some other 
high level lan()i:ige. 

GPSS is nut without disadvantages. Because it is a highly general approach 
to simulation, the mtJi'.'s produced are not as efficient as models written 
specificdlly for a particular ripplication. Furth(.»nnorL , the model must be 
constructed accurdiny to the conventions of GPSS with (he result that some 
foniis oF mutiiatri^ itioi, may not be as exact as would be mechanization via a 
tailored program. A single example will suffice to illustrate this point. 
GPSS produces models which are entirely transaction driven. This means that 
all events which occur within the system occur because a student reaches some 
point within the model. j 

In such a conceptualization, the instructor, for example, is a passive entity ^ 
reacting to tiie demands of a student, it is cumbersome to include activities 
which are instructor initiated. Once the student begins study of a module, 
he cannot be interrupted rrom an external source. Any breaks in module study 
must be set up prior to initiation of the model. 

While troublesome, these limitations do not preclude the uso of GPSS as the 
simulation language. Experience to date (see Level 1 Validation Results in 
this section) indicates that attempting to simulate detailed types of activity 
does not y>eld a significant change in model output. Highly detailed simula- 
tion is more appropriate for intensive study of a singlf." course rather than 
for parametric studies of a number of courses. Furthermore, detailed activity 
simulation demands precise and extensive data on the activities which take 
place in a particular course. Unless such data are available, it is not possible 
to justify the effort required to produce a detailed activity, simulation. 

GPSS was selected a", the ETE model source language because the objective of 
the ETE model was to provide a tool which could be tested for operational 
usefulness. Therefore, the primary thrust of the effort was to produce a 
model which could be maintained by the user and which employed conventions 
comnon to other such models. Had the project been oriented toward the pro- 
duction of elegant algorithms aimed at precise replication of detailed 
activities, GH^.S would not have been selected. 

ETE MOOa ASSUMPTIONS. On page III-2, four areas are listed which were considered 
troublesome to mechanize. Of the four areas, three were included in the ETE 
model and ttie fourth was not implemented. The activity not included in the 
model was that of preemption of facilities by students having priority over j 
other students. i 

Preemption of Ftici lities. Preemption was not excluded because GPSS has no 
provision foFactivities of this type. On the contrary, preemption Is 
explicitly included in the GPSS activity set. It was the lack of a set of 
general rules. for preemption which precluded its mechanization. In order to 
Include any activity in a general simulation model, it is necessary to 
describe those conditions under which the activity will take place. If 
preemption takes place at all, will it be on the basis of rank, student type, 
time of day, or some other factor? Since these conditions are apt to vary 
significantly depending on the organisation of the school being simulated, 
it was not possible to decide on an acceptable set of general rules for pre- 
emption and this activity was not included in the ETE model. 
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Remedial Activities, when the user specifies that remedial matter exists in 
a meaiun. outside the module under stu3y. he also suppHe the data necesLrv 
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fr^^l'^l'lf «sTc"ihe';eJS?al"mJt?l^^"^*"" ^" ''^^ 

This frequency is also done on a probabilistic basis u/ith am ♦u« j ^ 

t'h2" '''' percentage dlltr^bS" i rb ra y' nd '] ke'' 

the distribution of instructor time, can readily be changed. 

LEVEL 1 VALIDATION SCENARIOS 

«»del!*K??ls"tft\"^ e^^hiltzed!"""^"" ' -'^"^tion for the ETE 

syslJ; 5e«r[p't:on'(1nl2l)^^???on*' VTJ"'''. "^^^ "^^o" 'nd the 
;e«ia1ns the sSme frim ?un 'tl ru Sgt Si n? t silt 

to be simulated, change sian1ficanti„ rJ * 1*1'' describes the ILS 
system being sliulated d ctates the ^isu fc'^hl^^ °/er-e,nphasized that the 
characteristics such as se"itl»it« ^^ rLS^'!"'?''^''''"' """^^l. Model 
lated. not of the ETE logl2! ^ '"a'-aeterlstic of the as being simu- 

The other point requiring emphasis is that thp ptf m^^.i • . , , 
general purpose system oroi/iriinn • ! ^ """'^^ intended to be a 

Of different IL sJlteS .'^'Si^^^SS^^h'r?]'!;.* ^'??/?r =^™l«t'ng a varied 
should demonstrate two things { ) that Ih.^ ^'^.'f'l^^'''^ t*"^ model ' 
accurate enough to produce usefu results- 7^ "J;"? it » "-S is 
to simulate the system in question Dl«n'„n?^ iV """"^l was able 

describe the ILS inder study! ' '"P"* necessary to 

STEPS IN ETE VALIDATION. The primary steps In the ETE validation scenario are^ 
Discussion Of methods used to replicate different activities within 
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FIGURE III-5 ASSUMED DISTRIBUTION OF INSTRUCTOR ASSISTANCE TIMES 
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b. Review of ETE logic to assure that it reflects accurately the methods 
derived In step a. 

c. Test runs to ascertain that the GPSS program follows the logic design. 

d. Test runs using different combinations of input cHTta to assess reason- 
ableness of results. 

e. Simulation of a known ILS to provide comparisons of ETE model output with 
a known data source. 

Methods for Simulating ILS Activities . The basic activities required for an ILS 
simulation are enumerated under Model Description and Functional Specifications 
1n this section. Also in the same paragraphs, other activities which were con- 
sidered to represent problem areas for simulation were also listed. 

The logic for simulating the basic activities is straightforward and is described 
und^r both Model Description and Input Parameters Description. Detailed flow 
charts of the program logic appear in Volume III. Of primary concern during 
the design phase were those activities considered to present difficulties in 
mechanization. These activities and the decisions regarding their mechanization 
are covered under Logic Design. 

Initial Program Testing . The initial ETE test runs were designed solely to test 
all possible program paths. Curricula for five student types were set up, and 
Included modules representing each type of support requirement. These runs 
Indicated that model problems existed when team modules were encountered and 
also when team activities were followed by remedial activities. The latter 
problem required a change In model logic. In order to Identify the basic problem 
In team nodule processing. It was necessary to employ a GPSS debugging aide called 
T?ace. When Trace is used, it causes a print-out each time a student moves from 
one model block to the next. Figure III-6 shows part of a Trace output. Each 
transaction represents a single student. By checking the parameter values, it 
is possible to determine all conditions pertinent to that particular student, 
such as: step number within course; current module number and type; equipment 
requirement flags; and number of students in a team. 

Although this method produces voluminous output, it does provide a complete and 
accurate picture of model execution. By checking the printed parameter values, 
the accuracy of the current state of the student, and to some extent his recent 
history, can be checked. The Trace runs represented the most stringent test 
of model logic conducted. 

Reasonableness, Variability and Sensitivity Testing . Of these three types of 
testing* reasonableness and sensitivity testing can be Cwnsidered together. 
Variability testing will be discussed first. 

Variability testing was accomplished by running a series of runs, each of which 
was started with all initial conditions the same except the random number seeds. 
Random numbers are used In the following model functions: 

a. To vary the student generation times about an average value. 

b. To assign a student type to newly generated students. 
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c. To provide a 60/40 distribution of students requiring remediation. 

d. To assign the length of time spent by an instructor assisting a student. 

e. To vary module completion times about an average. 

If the model is highly sensitive to the particular distribution of random numbers 
encountered during a run, the results of these runs, using different random numbers 
seeds, could differ significantly in: (1) distribution of student types produced; 
(2) change in average time-to-complete due to change in remediation requirements 
and change (bias) in module completion times; and (3) change in instructor 
utilization. 

Table III-2 1s a composite of three runs made to test variability. A hypo- 
thetical system was simulated, so no significance should be attached to any of 
the outputs Insofar as real world systems are concerned (for example, it is 
to be expected that instructors will be utilized mwre than 3%-4% of the time). 
Each run was made with all initial conditions set lo zero except the random 
number seed, and run until four hundred students hai been processed. Module 
types specified Included groups, and those requiring instructor assistance, 
remediation, and other facilities. 

The data presented in Table III-2 show little variation in either average 
completion time or instructor utilization. Only in the distribution of students 
generated is there significant variation. 

Just how significant this variation Is In terms of model results is a function 
of the type of ILS configuration being simulated. If one particular student 
type tends to tie up large quantities of system resources, a twenty percent 
variation in the number of these students (with respect to other studerit types) 
could produce unexpected changes in model output. For the system used in this 
test, the different student types tended to be similar in their demands on the 
system. Consequently, little variation was encountered as a result of the 
changes in student type distribution. 

None of the results of these runs or other runs indicated any variability problems 
which would prohibit the use of the ETE model. However, the user should be 
cautious In applying model results under the following conditions: 

a. If the sample size is small (e.g., runs in which fewer than one hundred 
students are processed), variability In student input distribution can be 
hig'i. 

b. When the primary objective of the study is to obtain a student output 
profile over time, multiple runs should be made (following the technique 
described above) to check for possible variability. 

Reasonableness and Sensiti vit y Testing . Ideally, reasonableness should be 
measurable by a quantitative standard with the quantitative standard being 
historical data from a real world system. Those IL syltems currently in place 
in the naval training system are either too new or too limited in scope (e.g., 
an AOB of five students), to provide the desired quantitative standard. Further- 
more, application of the ETE to an existing system would not necessarily test 
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AVERAGE COMPLETION TIME 
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13 
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17 


14 
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17 



INSTRUCTOR GROUP 

RUN 1 
RUN 2 
RUN 3 



INSTRUCTOR UTILIZATION {% ) 
I II 



4.6 
4.3 
4.4 



2.8 
2.2 
3.1 



III 

1.4 
3.1 
2.2 



TABLE III-2 VARIABILITY TEST RESULTS 
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generality. That Is, It would be difficult to show that the model constructed 
and the results obtained did not represent the application of a special purpose, 
ad hoc model of the type discussed under Model Description. 

These conditions dictated a somewhat unorthodox approach to validation of the 
ETE model. Concurrent with Phase I of the DOTS project, an in-house Navy study 
of a proposed consolidated Electronic Warfare (EW) school was conducted. Early 
In this study, the decision was made to construct a detailed, entity flow simu- 
lation model of the proposed system. This model was completed in early 1974 
and has been in use since then. At the time that the problem of ETE model 
validation was being addressed, a requirement was generated by the EW school 
designers to make parametric runs using different numbers of s'.udent trainers, 
and a different student input distribution. This requirement represented an 
opportunity to accomplish both validation objectives at the same time. By 
applying the ETE rr^del and the existing special purpose EW model to the same 
problem, It would be possible, by comparing results, to check the ETE model for 
reasonableness and also to test Its ease of use vis a vis a special purpose 
model. 

.Objections could be raised to validating a simulation model by testing it 
'against another simulation model, but the techniques employed In the two models 
are sufficiently different to pinpoint any major discrepancies In either model. 
If the two models produce similar results, then questions regarding the validity 
of the results can be considered questions regarding the validity of entity 
flow simulation as a basic design tool. Of prime Importance In the selected 
approach. Is the opportunity presented to compare the lenqth of time required 
to produce a working simulation when using the ETE model, as opposed to con- 
struction of a special purpose model. If the time required to obtain results 
Is significantly lowered, one of the basic design objectives would be fully 
demonstrated. 

Consolidated EW School Model Description . The consolidated EW school has the 
following characteristics: 

a. Seven types of students. 

b. Nineteen possible curriculum steps. 

c. Four of the seven curricula have optional modules. 

d. There are three equipment facilities: carrels; student trainers; and 
a1 rcr«f t. 

e. Each curriculum step can include the use of both carrels and trainers. 

f. One cjtttgory of student has the ability to preempt equipment when 
necessary. 

The EW school model has each of these characteristics explicitly mechanized in 
the model. Where stude^ints move between carrel and trainer (and back) during a 
curriculum step, this mov^ement is specifically provided for. Optional modules 
are handled using conditional, probabilistic branches coded in-line. 
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There are othtr inodel features which were not specificallv required in the 
problem statement but which were added for completeness. 'These features in- 
clude: model operation on a twenty-four hour basis» with students leaving for 
lunch, and at the end of a school day. ^ 

* ProblemJUt^^ As has already been discussed (see 

Logic DeslgnTTthQ ETl inodei does nof include explicit capabilities for con- 
ditional branch.!S in a curriculum or for preemption of facilities. Optional 
modules were handled by creating separate curricula and by subdividing the 
input student classifications according to the stated probabilities that 
certain modules would be used. Preemption was not Included, 
fi 

Although It would have been possible to define submodules which would have 
provided for student movement back and forth between carrels and trainers 
durlng^a single module, this would have required definition of about two- 
hundred submodules. Instead, carrel time and trainer time were defined as 
single events during any one nodule. Even then, as many as fifty-six modules 
Ulce the nineteen In the problem statement) were required for some curricula. 
Figure III -7, sheets 1-3, show the Input data required to simulate the EW 

SCflOO I • 

The ETE model operates on a continuous time basis. Hence, there Is no pro- 
vision for idle time in the school, and results are given in total school hours 
rather than calendar days. This difference also required a change to the ETE 
model student generation function in order to achieve the same input rate as 
the EW school model. Note that this change was required to duplicate the EW 
school model for comparison purposes and would not normally arise when the 
user formulates a problem for the ETE model. 

V^A ^^?se stated exceptions, the ETE model had all the requisite capabilities 
to duplicate a highly specialized simulation model. 

RESULTS C0MHARI50N. Fai le IIT-3 shows a comparison of two runs made on the 
EW School model and the ETE n.udel. The differences between the two models with 
regard to time per school day. previously discussed, required that outputs 
from one modal be translated into the same un.its as the other. It is for this 
reason that the principal outputs were condensed in tabular form rather than 
being presanted directly as computer print-outs. 

LiUle commentjry is required concerning the comparison of results. Where 
translated results permitted comparison, a deviation of ^.9% in average time 
to complete was the worst case. Even this discrepancy is probably due to the 
fact that that particular student type comprised only 3.2% of the student in- 
put and, as such, represented too small a sample (only a single student for 
the special purpose EW model) to permit valid comparison. 

The fact that the ETE model did not Include preemption, student movement be- 
tween carreli and trainers during a single lesson plan, or simulation of a 
twenty-four hour day, did not materially affect the results obtained. 

Probltm Forniulation Time. Since one of the design objectives of the ETE model 
was to provide a rapid means for applying simulation to IL systems, the ttme re- 
ZlZtll ^^rtKu^^^'i^ results, given a specific problem statement, is highly 
important. The EW school problem took about five days to prepare and run on 
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17 FUNCIION P'*».L*j<» f-rt - ALL MiJuUL^:> 

f l/f2/i3/i4/i'»/ift/»7/,H/,q/,lO/,ll/il2/i n/» it>/» U/i 17/, If',/, Vit^^Ut 

^22f tZlf U<*f t^*if Uh/ f , inf ./'if t'*'Of , an - i/ , i if , i*if ,l'>f % i^f ^ f 
i38/,39/,40/i<il/i*^!/»<»3/i«»4/,<»'i/,«.6/,4 7/,<»rt/,'. </, jO/, 51/ f 54/ ,•>*)/, >6 

18 FUNCTMN H'iiL'Jl kw - N'j iJI*TIUi;ftl. "'ilj'JLf.S 
,3/,4/,6/,7/,8/,S/, to/, II/, 12/, l^/, 14/, l«5/, l»./, 17/, IM/, 19/,;|0/ 

,21/»22/,23/f 2<»/,?'>/,ii6/,4f7/,.>B/,t </,^0/,3l/o^/» i 3/ i 3<»/ 1 3^J/ » J**/ i 3^/ 
,38/f 39/«40/f Vl/,4//,4i/,44/,4S/,<.«»/,47/,*»P/,A )/ , >0/ , fjl/ , 54/ , t>S/ , '.f. 

19 FUNCTION H-?,L'><f l-'^ - uPTlorj I 

,l/»'i/,4/,6/, 7/, H/, >/, 10/, II/, U/, n/i l-V/i l^/» 10/, I 7/,ld/, I i/,.'0/ 

,2l/,22/f23/,24/,2b/,26/,2 7/,2f;/,*'9/,30/, Jl/f IV/, 3 3/, 34/, 35/ « i*^/* i?/ 
ti8/»39/i40/,4l/,42/,4i/,4<i/,4'i/,<»f>/,47/,4H/,4s/,SO/,5l/,54/,OS/,^h 

20 FUNCTION »>9,L':;< cU - OPTIC ! 
,2/t3/t4/,6/,7/,H/,^/, in/,1 I/, 12/, M/,14/, 15/, 16/ , 1 7/ , I H/ , H/ , ^i/ 

• 21/i22/f23/i24/,25/,^b/,27/,2f</,/.'J/i30/, 31/, U/, r3/, 34/, 3*>/, Jh/, 3 7/ 

• 3B/»39/,40/,4l/,42/,4i/,44/,4«;/,46/,4 7/,4P/,4T/,')')/,5l/,^4/,?'./,5t. 

21 FUNCTION fVvL5<; tr'.- - liPTlHN <» j 

,3/i4/,5/,6/, 7/,H/,9/,lf)/.,ll/, i2/, H/i l4/f IH/, l'>/, 17/, IM/, i^^/,^U/ 
,2l/.22/f2i/f24/,25/,26/,?7/,^n/,/.9/,3n/, 31/, 3^/, 33/, 34/,3H/, 3'./, V// 
,38/»39/,40/f4l/,42/,43/,44/,45/,4o/,4 7/,4H/,^ i/,50/,5l/,54/,'>'>/,56 

22 FUNCTIUN H'>,L53 f;W - UPTI IUS I i 2 
fl/»2/»3/f4/,h/,7/,H/,9/»lO/,ll/, U/,13/, l4/,l^/» 16/ , i // , 1 8/ , I */ , ^0/ 
,2l/»22/,23/,24/,^5/,2fc/,ii7/,?>J/,-i^/,30/, 5l/,ir./, 3 3/ , 34/ , 3*»/ , 3f / , 3 // 

• 38/, 39/ f 40/, 41/, 42/, 43/, 44/, 45/, <»6/, 47/, 4 rt/, 4 ^/, j(./, 5 1/, 54/, ►»«>/, "If. 

23 FUNCTION P9,L*»i BW - UPTlUNii I 3 

• l/»3/»4/f5/,6/,7/,a/,^/,l0/, II/, l2/,M/,l4/,i5/,i6/,17/, IH/, l'^/,. M/ 
i2l/»22/f 23/f24/,^5/f ^6/f 27/,iU/,/«i/,30/, 3l/» ii'/, 3 3/ , 34/ , 35/ , 3ft/ , 1 7/ 
,38/,39/,40/i4l/,4i»/,43/»44/,45/,46/,47/,4H/,4'^/,^0/,5l/,54/,5')/,'^h 

24 FUNCTION P9,L5 3 b'w - DPTIllviii ? v. 3 
f2/f3/f4/,5/,b/, y/f 6/,)/,lO/,U/f U/f ri/f 14/, 15/, 16/,17/, IM/, n/,^J/ 
f 21/ f 22/ 123/, ii4/, 25/, ^6/, 27/, 2H/,*f^/, 30/, 31/ »3^/, 3 3/ , 34/ , 35/ , 36/ , 37/ 

• 38/ • 39/ f 40/, 41/, 4<J/, 4 3/, 44/, 45/, 46/, 47/, 48/, 4^/, 50/, 51/, 54/, 55/, 56 

25 FUNCTION P'<,l;?5 PCO 

f 6/, 7/, 9/, 12/, 30/, 3 1/, 32/, 36/, 37/, 3fl/, 39/, 40/, 4 1/, 4;?/, 43/, 44/ 

f 47/ f 48/, 49/, bO/, 51/, 52/, 53/, 54/, .6 



FIGURE I!I-7 (CONTINUED) 
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•the m rnodel, with some loss of time in obtaining problfim statement data. 
Given a problem statement formulated in accordance with th« requirements of the 
ETE model, two or three days should be adequate for a problem of this magnitude. 

With the exception of the TTE model change required to match the student Input 
rate of the special purpose EW school model (see Problem Statement Using the 
ETE Model), problem formulation consisted entirely of input data preparation. 

MODEL SENSITIVITY. As previously stated, sensitivity is more a function of the 
ILS being simulated than it is of the ETE model itself. I»^?,,^W ILS is highly 
sensitive to input student rate. For example, a change of 11/. in tnej"P"J 
rate causes a greater change in system performance than a change of zo/o-zs/o 
In the number of available trainers. 

This phenomenon was also experienced when earlier test runs, using other types 
of ILS. were made. All ILS configurations so far simulated, have exhibited a 
"layering" effect in sensitivity. This layering effect causes a single variable 
to mask the sensitivity of the system to another variable. 

For example, 1n the EW School ILS, the system proved relatively insensitive to 
the number of trainers available (which was the parameter of interest to the 
designers), because the student input rate, the number of study carrels, and 
the length (in time) of the lesson plans combined to mask the effect of the 
variable in question. If the number of carrels was increased or the length 
of time spent In the carrels decreased, the system would then become sensitive 
to the number of student trainers available. 

LEVEL 1 VALIDATION RESULTS 

All of the numeric results of ETE model testing were presented under Valida- 
tion Scenarios. It remains to sumnarize those results and to point out any 
significant factors regarding the ETE model, its performance, and its application. 

ETE MODEL PERFORMANCE. A significant difference exists between the special pur- 
pose model and the ETE model. The special purpose model took 3 hours and 20 
minutes of computer time to simulate 80 days of school time. The ETE model took 
35 minutes to simulate the 80 days of school time. The implications of this 
difference will be discussed In the summary at the end of this section. 

The ETE model did exhibit sufficient variability to warrant a caution to be 
Issued to the user. 

Model performance, with respect to problem preparation time 
time, appears to be acceptable and warrants use of the ETE model for any further 
EW school studies. Model sensitivity and reasonableness were the same for both 
the special purpose model and the ETE model . 

SUMMARY. Experience gained in testing the ETE model leads to the following 
statements concerning the application of simulation to IL systems. 

CoiiiDlexity of Representation . The almost seven to one reduction in execution 
time exhlBited by the LU mod el when applied to the EW school problem, results 
from Its relatively simple system representation. Complex problem mechaniza- 
tions are costly and should only be used when the system under study is very 
precisely defined. 
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System Sensitivity. The sensitivity of the EW ILS to input rate indicates that 
theTnTtOTlroFlem statement should have included a student AOB. This would 
have made the system less sensitive to input rate and more sensitive to school 
configuration. The conclusion to be drawn from this is that the user must 
review the results obtained from any simulation, so that studies are conducted 
In step-wise fashion. When one variable appears to be the principal system 
driver, additional parametric studies involving other variables will not y1e.ld 
meaningful results. 

Because of Us generality, the ETE model provides an effective tool for con- 
ducting initial sensitivity studies on any ILS. When sufficient system data 
exist to justify very detailed simulation, special purpose models can be 
developed beginning at a high level of system definition. 
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TRAINING PROCESS FLOW MODEL 
MODEL DESCRIPTION AND FUNCTIONAL SPECIFICATIONS 

FUNCTIONAL SPECIFICATIONS. The objectives of the Training Process Flow model 
are: 

a. To provide training management with an ability to assess the effects 
upon the training system of projected changes in: 

• Demand 

• Scheduling 

• Capacities 

• Student Attributes. 

b. To develop model output data formats that provide high informational 
content to training management, so that effective decisions can be 
made for maximizing the utilization of training complex resources. 

The TPF model will be capable of assessing the impact of changes in certain 
input characteristics at the course level, and of showing the effects of these 
changes at the school and complex levels. Some examples of the course modifi- 
cations which can be entered Into the TPF model are: « 

a. Annual demand 

b. Class capacity 

c. Annual number of convenlngs 

d. Course length 

e. No-show rates 

f. Student failure rate 

g. Student setback rate 

h. Selected student attributes; e.g^, average GCT scores. 

The model is intended to have two levels of data access; one level is into the 
existing DOTS data base which Is also used by the SCRr model; the other 1s In- 
to the Statistics data base. Operation' of the model at course, school, or 
complex level Is possible through selective transfers of data from the DOTS 
data base to a Scratch data base which can also be accessed by the TPF model. 

The final output effects of the model are measured^n terms of: ' 
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a. Averaye-on-board (AOB) 

b. Utilization 

c. Bauklog. 

Znterwedlate ofUUs available as model output are: 

a. Pass/fall rates 

b. Setback rates 

c. f*o-show rates. 



The Model Description section expands upon these areas and provides examnles 
of output reports which present these types of data* P^^oviaes examples 

MODEL DESCRIPTION. Figure IV-1 shows an outline of the TPF model, and the 
major support programs Integral to the overall TPF model system. 

.Mode] Programs. The TPF model Is designed to be operate ' a stand-alone 
model, or in conjunction vvlth the Integrated system shown In Flatl^ I?-? 
The purpose of the TPF modal Is to analyze Indlvldua c22r e dISaids sihedules 

Jh** s^il^f V""^^"."^? n "^"^^^ b^S^nn^'s Of r? cll year! 

and project these data for periods of up to three years. Specifically the 

l^S HuPplfi'^S'' joncern course capacities, lengths, convening schedulw.^ 
T^nn^^il^ rtT'^l historical rates for no-shows, failures, and non-academi 
dropouts. These inputs are based on current or projected schedules and loarfc 
and are reaHly awiiable from existing printSutrrlports and pllns One 
final group of input data elements concerns student attributes? -ihis Includes 
characteruucs su.:h ai the student's scores on the various AmedForc« 
entrance exams, rate. age. service time, and other parameter^ Thirstatl. 

J ^1""'"^ ^" Volume IIl!'sectio^ iT* ll^w s'dedd^d 

to analyze this large amount of statistical data offline rather than In « 
ine component of the TPF model. However! ihl resultl of thiS Sf?11ne anllv° 
sis are made available to the TPF model as an input. ^ 

nUmT^^Atl "^V^ data from two main sources;. first, the DOTS or modi- 

fied DOT> data base, and secondly, from card Input. This dial input caoablltv 
is mportant to the user. The DOTS data base interface allows the user to 
analyze projectiot.s based on the current operational plan, includino the 

L\1in'al^^a ?r.n./^^''P^^UI^y Of modifjing this daia base a liSf tKe ' 
testing of alternate plans within the overall system. The alternate card 

Ipl^Vihe^'daS'bL'e!^^"' °' several alternate Jlans . wi?h%2t thTnl^^^^^^^ 

Any input parameter to the model can be considered a variable for maninula- 
tlon to achieve the desired end results. Any course length c^cuJ Schedule 
demand, or attrition rate can be modified fo> detailed analysis. The model 
filll i^? operation of a course with one set of characteH sties ?or 

?rrel?n3^?^if^iKe ^"^^^^^ ''''''''' characterilt'iS Z 
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The TPF model print format contains a synopsis of the input data on the left 
side of the page and cTiartcrly projections on the right. See Figure IV-2. 
The courses are nom^iny grouped by schools, with a school summary report 
following each yroup of couises. A Center report is also printed to allow 
evaluation of any rhanges on the overall Center totals. The model also allows 
execution of the sanie course under different configurations in one model 
execution to givti side by side comparison of the effects of alternate inputs. 

Support Prog rams. The support programs fall Into three categories, those pro- 
grams that interlace with and support the data base, those that provide 
formatted inputs to the mode"', and those that support the statistical analysis. 

The programs thut support the DOTS data base, provide update capability, and 
allow the creation of a r. cratch data base, are covered in Volume III, Section V, 
of this report. 

Two programs support ti e interface between the TPF model and the data base 
parameters. The first program, UNLOAD 1, allows the model to execute with 
current or scratch dcita base inputs, with additional steps required by the 
user. This program fonint', the data base parameters Into "card image" re- 
cords, which are compatible with the alternate TPF model Input formats. 

The third yroup of support progiams correlates the student statistical aver- 
ages with the significant coefficients from offline regression analysis pro-- 
grams, and provides statistical failure rates for those courses undergoing the 
analysis. This allows the user to modify such student attributes as average 
rate, average age, or average ^est scores, and automatically update the TPF 
model failure rates. The support programs that provide this function are 
called FAILl, FATL2, and FAI13. 

INPUT PARAMlTERS DESCRimON 

Four ; rlmary inp it priramelers were defined and analyzed during the design 
portiun of iha Tralnifi Procf?ss Flow model effort. The four inputs, student, 
• demai.d (or load), behavior, and delivery system, were further subdivided into 
a number of spocific attributes for detailed study. During this detailed study, 
it I 3came obvious that 'hese inputs fell into two specific categories; those 
thac pe taii.sf' lo s'.udei»t behavioral characteristics, and those that made up 
the mechanics of the schoolhouse operation. It was decided at this point to 
study these two categories as separate entitles. The analysis of the student 
characteristic was tarried out, in part, using various programs in the Statis- 
tical Packaye .or L;.e Social Sciences. Data were gathered from several sources, 
and t! m:,0) effort went into this portion of the stu4y. A detailed discussion of 
thes. ifforts ^ay b? found hi Volume III, Section IV, of this report. During the 
entire study, however, there was much interplay between the two fields of study, 
as the statistical analysis often answered questions as to what affected certain 
elements in the training complex operation; and I1l<ewise, understanding the 
mechanics of the Fleet Training Center, Norfolk, Virginia, gave much insight 
into the naturt of the 5t.ii.istic*5 obtained. 

The first part of this discussion will center on the various elements considered 
as potential inputs to tho TPF model , followed by a description and format of 
those inputs actually required for operation of the modeVJn its current form. 
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Nearly all of the data and statistics gathered pertain to the Fleet Training 
Center, Norfolk, Virginia, which, for the remainder of this section, will be 
referred to as the "Center." 

TPF CANDIDATE COURSE DATA INPUTS. The course, combined with the school facili- 
ties, has been temr^d for this study, the delivery system. Several parameters 
were singled out fur study a^. to their inclusion in the TPF model. These 
parameters are: 

a. Course type 

b. Course complexity 

c. Course length 

d. Instructors 

e. Facilities 

f. Materials 

g. Media 

h. Training aids and devices 
1 Support personnel 

j. Shift work .requirements 
k, Locoticn of training 
1 . Outside as 'ynmnnts 
m. Degree of remediation 
n. Relevdiicy to job 
0. Testing system. 

Course Type . This refers to the type of course and the teaching method. The 
courses sludiud at the Center fell generally into two categories, team or un- 
graded tr-iining. and lockstep. A team course can be categorized as one that In 
most cases produce;, no failures. Examples of this are course 510B, Firefighting 
Team Training, which processed approximately 2275 students during the last 
fiscal year without n failure, and course 509N, Damage Control Repair Party Team 
Training, which processed approximately 4075 students without a failure. Indop- 
tri nation, orientation, and refresher courses also fell in the team or ungraded 
'category. At this Centres, students attending these types of courses are approxi- 
mately one- third of the total students. However, these types of courses tend 
to be short, and the Average On-Board (AOS) they contribute is nearer 10 pe^rcent 
of the total. One of the primary objectives of this study was to suggest methods 
to Improve throughput*of the courses through the analysis of failures. Obviously, 
courses that don't produce failures defy this portion of the study. On the other 
hand, these courses contribute heavily to the inefficient use of certain resources 
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due to the hiqh no-show rate experienced. Thus, these courses were inputted 
?o the mleTfs team courses (type code) to indicate their non-graded policy, 
and win be discussed again in the section covering demand. 

By far. the largest category of courses could be ^^^^^J"^;!!?" f J^lJ.f ^'^'P' 
It was out of this group that courses were chosen for statistical analysis. 
The mjSrity used s5me ^thod of grading, although there were several grading 
systems In use. The reason for this non-standardization in grading could perhaps 
be atfriJSted io the fact that neither the grade "^If ^ e s udent s s and s 
recorded in the data base maintained for the Fleet Training Center by D^'^'-L^^nf 
aroart of the student data system. Instead, this data base contains a Student 
Act?o^Vode or sac! which indicates such status as jtu ent o"" "J^^^^^" ^ 
disenrolled for academic reasons, accelerated, or set back. This code gave some 
fnsi nto cer?a^ activities of the students, but again ^ajle to provi e a 
dependent variable with which to measure student success. JJ"s it wa decided 
to obtain the actual grades and standing students in a representat^^ 
of these lockstep courses in order to run the ^^ired analysis. This was 
accomplished by obtaining copies of all course records for 42 of J^ese courses 
fSr ?he last six ninths of fiscal ye;»r 1974. The numerical data gathered were 
used as Inouts to the statistical analysis study, while the instructor s notes 
fnd subseSSent iSteJvievIs were used to determine portions of th%rnodel scheduling 
and disen?bllment logic. Another type of training conducted at the Center is 
ILS. or individualized Learning System. ILS-'may take two forms at the Center. 
schedSled instruction and Progfaid Instruction (PI . Only one course is 
currently held at the Center Gsing ILS. and the model makes no special provision 
fSrihls type of training. On the other hand, once a course is converted to PI. 
Its admlnlMon Is no longer a responsibility of the Center, and the course 
dols not appear In the modelT As the TPF model Is a flow, rather than Center 
resource model, no provision Is made to include the effort expended to convert 
the course to a PI format. 

rn.meo rftiTinipyitv It was felt that the model should use as an input parameter, 
sg^faS to Ind icae courre cS However, no relationships between 

S c5S ifxliy I^^^^^ rate? could be determined ^ojJJ^P 

0286, General Technical Stores Operation, produced a 35.4 percent failure rate, 
while the fa lure rate for all courses In the technically more complex ET 
school if between 1 and 2 percent. This is attributed largely to relevant 
schSS ing andTtu^^^^^^ and thus course complexity was removed from 

lur mode? Input parameter list. NAVMACLANT has been Jji^S studies that involve 
the area of course complexity, and It is recomnended that this area be pursued 
further. 

Course Length. Course length was initially included as an input parameter with 
»£a hoUlf SL t the lonqer the course, the higher the possibility for non-aca- 
SS^Ms fSr^er^o Operational reasons. Although course length 

doSs offirriaHable w^^^^^ for these'conditions to exist, again no usable re- 
lationship was found to exist directly. In longer courses, the increased 
iSUStia fS? dropout appeared to be overshadowed by the, course's relevancy to 
the Sob or lhalleSging technical content, as well as by improved student selec- 
tion. Also, it was concluded that, by and large, for courses greater than two 
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weeks, students droppiny out for non-academit ii»asons had 5 i mi Tar character- 
istics as those who fail. For shorter courses, especially those where the 
training is not overly critical to the operation of a r^hip, the non-academic 
dropouts are more aligned with immediate operational demands. Length is also 
not used in calculating pass/fail statistics, but i'". in the- dmu base as 
an independent v".riaMc for statistical study. The TPr model does use course 
length a-' an input ' ;r scheduling and AOB purposes. 

F acili ties. T^>e f^^'lities used to conduct classes v/ere used as inputs to the 
Tpf mocfel only to the extent they affected course capacity. These facility 
capacities are also Inputs to the SCRR model. No analysis is made as to the 
type or quality of these facilities and their subsequent impact on the course 
failure rate. 

Media and Tra ining Aids. As r.tated earlier, the studies centered on the char- 
acteri sties 6T the students, and the attempt was made to relate the failure rate 
to the characteristics 0: the student. Quite obviously, much can be done to im- 
prove the course content through the use of various training aids or devices, 
and during the utudy many indications of this were found. However, the impact 
on failure rate from tiie introduction of new or improved training aids and 
methods Is an offline study. Thus, the use of these aids might revise the 
failure rates for input to the model, rather than being a direct input. 

Support. PersoiineVSiiift Work . The SCRR model determines the feasibility of 
accomplishing the desired training plan with the direct teaching resources avail 
able. Thus, any proposed convening schedule should be verified using this model 
Neither .Tiodel makas an .ittempt to analyze other support personnel, or the effect 
of possible roorganizations on these resources. Also, as only a small fraction 
of the training at this Center is conducted in the evening, no attempt was made 
In this study to analy.!e the relative effectivenes of training on different 
shifts. 

Location cjf^ fri.Jjii^. This duta element refers to the location of the training 
reU"tivel;o T. j stTS^nt's bise location. The most common Interpretation refers 
to a stude. ...ti :ed 'n the Norfolk area, versus one sent from outside the 
area to attend schools. One class of this latter group of students, those 
students on PCS nrderJi, vms extracted and subjected to statistical study. PCS 
code L'xists as p^rt of the statistical data external to the model . Anouier 
interpret? wi on of •ocatior cidd found to have some significance was the fact 
that the si^udeni: was aboard ship or on shore duty. Again, this factor was made 
part of the slati<'tica1 analysis and not entered directly as a model input. A 
third location code was identified, that of TYCOM sending the student. This 
TYCOM code a^'ain if used in the statistical analysis. 

Outside Asrigr. nients/Degree of Remediation . Several of the courses require out- 
'side assignments, and some laentinaoie percentage of the failures are caused 
by lack of successful completion of these assignments. Likewise, most instruc- 
tors wert willing to spend considerable time and effort on remedial activities. 
However, thuse parameters are not loaded directly into the model. This is be- 
cause these faCbOrs are adequately covered by the student characteristics 
already available. In the first caie, outside assignments, a high correlation 
was found uctwC'^n lack of experience and the amount of outside effort necessary 
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to assure success; likewise, In the same courses thore was a similaV corrola- 
tlon between experience and success. In the second case, remediation, this 
remediation was available to all students, and thus, success when remediation 
was required depended again on a combination of other factors. In summary, 
the lack or availability of remediation may vary the overall course failure 
rates. However, this failure rate is a TPF model input. 

Relevancy to Job. This factor stood out quite strongly in the studies of 
historical failure rates. Probably the most striking example was the comparison 
of course 3150, Storekeeper, Independent Duty, with a failure rate of 2.9 per- 
cent, with similar course 4700, Storekeeper, Dependent Duty, with a failure rate 
of 14.6 percent. These courses are quite similar, cover the same fields, both 
award NEC's, and 1n fact have common sections. The difference in failure rate 
must be attributed primarily with the relevancy to the job. coupled with the 
obvious preselection of students. Again, this element is not used as a divect 
entry to the model, but is considered as a statistical input. 

Testing System. Finally, the method of grading came under review. As stated 
earlier, several methods are used for grading. They vary from ungraded, to 
arbitrary attitude decisions, to outstanding/good/weak systems, to point and 
percentage. The method of grading was not analyzed as to its effect upon student 
progress. Rather, it was necessary to standardize these Inputs in the statis- 
tical data base so that valid comparisons between courses could be made. 

TPF CANDIDATE DEMAND DATA INPUTS. As with the course data, several Initial 
assumptions were made as to student Input demand parameters. They were: 



a. 


Number contending for training 


b. 


Fallout during enrollment window 


c. 


No- shows 


d. 


• 

Unplanned Inputs 


e. 


Attritions 


f. 


setbacks 


9* 


Average-on-board 


h. 


Timing of arrivals 


1. 


Fleet movements 




Weapons systems cycle. 



A d1scus<.>1on of these potential Inputs follows. 

Number Contending for Training. This term is analogous to demand. Demand it- 
self, during the study, was-lnown effectively to consist of two components at 
the Center; that controlled by local quota control, and that controlled or 
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schedu1»id by ail other c>qenc1(is. The large majority of ttiis Idtter demand is 
controlled Ly rUPERS and, for purposes of this study, ari students not scheduled 
by local q <( cc^trol were grouped for demand purposes inio tfie SUPERS 
category. This Inul'ided .tudents from the Coast Guard, Marines, Federal Bureau 
of Investl'jatior;, and othtr Govornmental and civilian agencies. 

Fallout Duri ng Ei.a UiiRni; Window. This input element waii intended to show those 
quotas reque'stcTahu the ~ cancel led prior to the course start. However, it 
proved impructicei tfj collect these data, so the item was dropped as an input. 
One rationalisation f(ir tiiis wjjs the fact that during the initial appraisal of 
the Input par«':ar£. , it was felt that this fallout would increase as the course j 
backlog, or length of t1niu till vext quota, increased. During analysis, this ♦ 
was found not to be so. Fallout and no-shows were more a factor of relevancy to 
job than to tny wait tine to attend a course. 

m 

No -Shows . Heny dr l:a were gathered to ascertain no-show figures for the school. 
DPS CL ANT ir.i.nt ins a filn ..b part of the Student Data System containing all 
local quotas retiUdite'i and, subsequently, those quotas that are utilized. A 
program was written at IBM's Cape Kennedy Facility, and through the cooperation 
of DPSCLANT, thui's dnta wore reduced for model Input. A sample printout of this 
report Is shown in Fiyurt IV-3. No-shows were an important part of the study 
as they ste<.l capacity 'ind, in some instances, cause backlogs for critical courses. 
The data obtained from DPSCI.A1'<T not only contain the numbers of no-shows, but 
ship type, "iead tirno, TYCOK, and numbers of quotas actually utilized. Only no- 
show percentages v/ere used a^> model inputs, but It is believed that additional 
statistlcul analysis of this area will prove useful. 

There is an indication that a strong statistical relationship exists between non- 
acadenic dropouts /^nd failures for courses greater than one week. This was one 
of the areas, however, that because of time limitations, could not be pursued. 
Therefore, thr n]od ^1 presently uses historical non-academic rates as an input, 
with oth(!r pruvlsicns for future updating through the statistical program inter- 
face. O.ie probl ;n nrea uncnvered In the statistical analysis of failures was 
actua'ily .li'iiiln j "what i^ a failure," The best example of this Is in course 
536N, dolur Peedwuto^^ and Test. During the last six months of fiscal year 
1974, this course ter.orded one failure, while a much higher percentage of the 
students we^'u not certified upon course completion. This again points to the 
deiiirability ior sUndardi/.atlon in grading systems. 

Aver age On 3o ''rd. At thtj beginn1n<j of the study, this variable was considered \ 
an input tr? be ur sd hj the model as a control figure. During the development, 
hjy;3v^'\ it was dro;)pei.l as it was felt more desirable to calculate the AOB 
basad o: ..uads a .d convening-, and let the user interpret the results and 4 
inanjilly iUJu^t tho inputs to achieve the desired results. 

Timing of Ar ri ,j1s. One problem confronting the Center is the extreme varia- 
l fobs all d i^eJflTT^'y •inpred1ct:^ble arrival rate of students for training. This 
unpredictc'bv nature of the inputs is compounded by Fleet movements, the number 
of sources of students, and the variety of priority schemes. Fleet makeup and 
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movements offer one potential for a model to be associated with the TPF model. 
Through the study of historical data, it is possible to predict the demand for 
many of the courses based on ship type and TYCOM. However, a large portion of 
the students at the Center are oetailed from BUPERS. whose planning cycle is 
outside thG pre'snt scope of the TPF model. Secondly, many students are 
seasonal, sue i as midshipmen and reservists, which again would form another 
Input to ^ny Fieet model. Another complexity to a Fleet model is the priority 
schemes for qntai dmnrj and within TYCOMS. Finally, precommissioning 
activities impo"'^ dcjmi^'^ds that are unique in nature and add to the complexity. 
During Pha^-^i I ui this .tudy, a Fleet model was discarded as of limited value 
in a model system of this type. During this study, it again became apparent that 
the benefits tr< ba obtained ly the dynamics of an input. Fleet model are not 
presently worth chti large additional effort. 

Weapons Svstu n Cycjo. This input again represents an attempt to automatically 
Introduce dynamics to ',he input demand. However, this input requires offline 
analyses, and the demands imposed by the various stages of the weapons cycle 
can manually be inputt'id through the standard model schedule and demand inputs. 

DATA BASE INPUTS 

AM model parameters for the TPF model can be stored in the DOTS data base. 
Volume in contains tho complote format and update procedures for loading and 
updating. Hcweve) , cerUin of these data elements should be defined in this 
model to asiiure proper operation of the TPF model. Also, all formats and 
further definition are found in Volume III, Section IV, of this report. 

Many of the* djta agjreciated for the current TPF model have been obtained from 
several sourci:s. A prv^ram was written to assist the gathering effort, and to 
analyze the (Iffference- 1n data from alternate sources. An example of the data 
gathei inu »0i la'. is ^ ^wn in Figure iv-4. 

CDP. ''"hfe GDP uumbcr ihe new 4 character data processing code for all courses. 
This code Is rec^ui-.t^d fur data base. Input, but Is used for printout identification 
only In the TPr ;0'jei . 

SCHOOLo 1 iC school co»e 'li the 6 character code for schools of the Fleet Train- 
ing Center. The TPi model calculates totals upon encountering a new school code 
In the inp'jfc nreaii.. Thus, it Is important that care be taken that the correct 
code Is crti;ercJ, and that the courses be entered In sorted course order. 

CHANGE DATE. Thr jhar.^a dale allows the model to represent course changes. The 
"A" conveni.igr., tidgths. and capacities will be used by the model prior to the 
change week, anJ the "B" convenings, lengths, and capacities will be used follow- 
ing tie chan-3 weok. The dati entry for change week itself Is the week of model 
run in which the "A" schedule should be dropped and the "B" schedule picked up. 

An entry of 53 (first week of second year), for example, would indicate that the 
"A" schedule should be used for the first year, and the "B" schedule for sub- 
sequent years. 
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CONVENINGS (A AM) B). This represents the annual convenings per year for a 
course or, In the case of a course undergoing a change, the convening frequency. 
For fe/aniple, if a course convenes every other week fpr the next three months, 
then ends, tho "A" convenings should be entered as 50, the change week entered 
as 13, and "B" convenings ihould be entered as 0, which will terminate the course. 

LENGTH (A AND Loaglh represents the actual course length in weeks, and is 
enter ed in t' o dcta bas« with 1.0 representing a one week cou^-se, and 0.2 repre- 
senting u one day cotus?. "A" represents the course length prior to a course 
change, and "B" reprcseii^is the length subsequent to a change. Only the "A" 
length 1s required if no change is indicated. The TPF model executes using 
course length in either weeks or days, depending on the option chosen through 
the AOB constant p?irameter. If the days option Is chosen, a two week course 
(2.0) will be ounvertf»d tu a twelve day course by the model (10 school days plus 
two weekend days ) . 

CAPACITY (A AN.O B). Thii represents the current limiting student capacity, per 
class, of the course. "A" represents the length prior to a change date, while 
"B" represents the length subsequent to the change date. This capacity Is the 
maximunt allowable sti dent input, and includes locally scheduled students, as 
well as SUPERS sche^iuleJ stu('ents. 

SUPERS CAPACITY (A AND li). TMs Is the number of seats controlled by SUPERS or 
other agencies, and is a portion or all of the capacity of the class for those 
courses under SUPERS control. If a SUPERS demand is indicated with no SUPERS 
seats, a warhiag message will be printed and the SUPERS demand will be honored. 

SACKLOG. This represents the length of time In weeks a student must wait for a 
scheduled f.jota in ? coi rse whr^e nearest convening Is totally booked. This back- 
log in wejkc is convened tu jtud;nts backlogged during the TPF model initializa- 
tion. The TPF reno 't .1st;; the backlog in both weeks and students. Some intu- 
ition must 'i.^ u ad to resoV/e those unique cases where the actual backlog in 
weeks is lot cluar. ^xampler. of this situation are courses that may convene 
very Infrtqui tlv, or those courses with quotas reserved by TV COM, such as where 
all quotas an? L . .cd tvccept for CuHSUBLANT. It is anticipated L' at the data 
basii will L : mouifiv^d to al.ow the backlog Input to be in students during the 
Phi-se Hi effort. 

DEjIANU. Tl.io rtr;i<.'o Sills the planned annual Input to the course for students 
booked throui,h lo..al quota control. It does net Include students scheduled 
through BUPEHSr" 

SUPERS DEMD. This ir.put represents the planned SUPERS annual demand for the 
cour';e. This ai.pual dp'r: id will be honored by the TPF model, even if overbook- 
ing of classes is involved. 

FAIL RATE. Thi'j represents the historical failure rate for the class, including 
academic dropouts. Statistical Inputs can overwrite these data for selected 
courses. 

NO-SHOW RATE. This is the historical uo-show rate for*students scheduled through 
local quota control. This is defined as "No-Show Rate = No Shows/ (No -shows plus 
utilizatlonj." 
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NON-ACADEMIC DISENROLLMENT RATE. This represents the historical dropout rate 
for non -academic reasons. 

0 NUMBER. This Is the last 4 digits of the J numbering system (presently being 
replaced by CDP designations). All J numbers for the Center end in 2. This 
number Is used both for reference purposes, and also to load statistical data, 
as DPSCLAWT historical data files have not been converted to CDP numbers. 

OFFSET. Offset is an optional input and is used to modify the schedule matrix 
to allow fine tuning of the actuel convening date of courses with low convening 
frequencies. The primary purpose of offset 1s to assure that the AOB created by 
a course convening 1s allocated to the proper quarter. Courses with convening 
frequencies between 1 and 50, will convene according to the matrix shown in 
Figure IV-5. Offset allows the user to shift this matrix to the right or left. 
For example, an offset of 3 will subtract 3 from the actual week in session. 
Thus, week 4 of the model run would use week 1 of the matrix; model run week 5 
would use matrix week 2, and so forth. This matrix should be considered a "wrap 
around" matrix, that is, week 53 should be treated as week 1. 
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NEC/CATALOG NUMBER. These two elements are printed in the TPF model report 
for references. They are obtained from the DOTS data base, are not used in 
processing, and are not considered model inputs. 

OUTPUT PARAMETERS DESCRIPTION 

The primary TPF model output is the yearly course summary format, shown 
in Figure IV-2. This format is broken into two parts; the left portion which 
gives a synopsis of the inpu". data, and the right hand side which tabulates the 
fiscal year projections bas«d, In part, on those input data. The data elements on 
the left h9Ve been previously described. The following discussion will, there- 
fore, concentrate on the yearly course projections. 

FORMAT. The output is broken Into 4 quarters of equal length (13 weeks). The 
first quarter is assumed to start 1 July of the fiscal year. This is signifi- 
cant as the model will not run courses during the Christmas period, which is 
assumed to be the last week of the second quarter, and the first week of the 
third quarter. Annual totals, as well as percentages, are printed for applicable 
data elements. 

NUMBER OF CONVENINGS. This represents the total convenlngs of the course, by 
quarter. A convening date Is defined as the day of the first class for a course 
section. Thus, convenlngs are accumulated for a quarter based on the beginning 
date of the class. For example. If a course with a length of 11.0 weeks con- 
vened In the 13th week of the 1st quarter, the convening will be counted in the 
first quarter, even though the bulk of the student AOS falls In the second quarter. 
The model calculates course convenlngs based on annual convening frequency, the 
current model week, offset, and change week. An example In the use of change week 
to terminate a course can be found In Figure IV-2. The first course, GDP number 
3081, Is scheduled for disestablishment approximately 7 November. A change week 
of IQ is entered with a new convening frequency of zero, and It can be seen that 
tha course Is terminated with only one convening in the second quartev* and none 
thereafter. 

COURSE CAPACITY. This represents a total of the limiting student capacities 
on thu day each course was released, by quarter. On the day a course convenes, 
the model tests if this convening is prior to or after a schedule change date, 
and the current capacity is used. 

UTILIZATION. This is the total number of class seats occupied on the day the 
course convened. That is. It is a total of the local quotas granted, minus no- 
shows, plus BUr'ERS Input, plus substitute quotas. The exact algorithm that con- 
trols this is discussed in the Program Description portion of this section. 
This nlgorithm does make allowance for overbooking of critical courses. An 
example of thi'-> is course 3400, in Figure IV-2, which shows that during the 
first quarter this course ran at an average of 102.2 percent capacity to work 
off a schedule backlog. 

NO-SHOWS. This is an historical average of students not showing up for the 
course who had previously been granted quotas. Only that portion of students 
schedule^ through local quota control is counted in the no-show figure. 
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Students scheduled from BUPERS do not contribute to no-shows in this model 
as: (1) they are usually under TAD orders; and (2) the school has no record 
of these students until they arrive. No-shows also are not derived from 
substitute quotas for obvious reasons. Based on this use of no-show rates, it 
Is Important that the historical no-show rate entered in the model be based on 
the sum of no-shows and utilization, and not on utilization alone. 

BACKLOG. Backlog is defined as the time a student must wait for a confirmed 
quota in a course that is booked. The backlog printout is a snapshot of the 
actual backlog on the last day of the quarter. The model input portion of the 
format gives the initial, or beginning backlog, while that contained in the 
annual totals column is the ending backlog, which is identical to the 4th quarter 
backlog. Backlog is entered in weeks and is converted to students who hold 
quotas. The output report shows backlog In both weeks and numbers of students. 

AOB STUDENT DAYS. Student days is the total, by quarter, of the number of days 
each student has spent in a course that quarter. Thus, it is possible to show 
student days in a quarter that had no convenlngs. Students set back to a course 
do not count as utilizations, but the student days spent in that convening are 
totaled. Two methods of calculating student days are available In the TPF model, 
with the method decided by the value of AOB constant entered. If this constant 
Is less than 300, student days is the total of class days times students, 
adjusted for setbacks and quarters. If the AOB constant Is 300 or greater, 
student days Include weekend days for courses longer than one week. If a course 
spans two quarters, the weekend days for that week the span occurred are charged 
to the quarter In which the course convened. AOB is the student days divided by 
the AOB constant, which is a model Input parameter. This AOB Is multiplied by 4 
for the quarterly outputs. 

PASS/FAIL, ETC. These are historical pass/fail and non-academic disenrollment 
percentage rates. Updates to these factors require additional statistical 
analysis of current data. Academic setbacks are hard coded into the logic of 
the model and are based on the fail percentages. The criteria for setbacks are 
discussed under the logic design portion of this section* 

MODEL/DATA BASE COMMUNICATION 

Communication with the data base is a one way flow, utilizing a group of 
support programs to make data base parameters available to the model. This flow 
can be seen In Figure IV-1. The flew initiates with the procedure to create a 
temporary, or scratch data base. This gives the user a capability of modifying 
the temporary data base to run the model. A program, UNLOADl, exists to re- 
format these data for input to the TPF model. This program breaks data base 
parameters into two data sets. The TPF model utilizes multiple input data 
sets to minimize both core storage requirements and execution time. The only 
calculation occurring during this operation is the blanking of the NEC code, 
should the nuirtber 0 occur. The program also makes available a card image of each 
of the data sets. The user can either print or punch these data by changing 
the JCL control card. Thus, the user can obtain a punched deck of all TPF 
model inputs from the data base. This in turn allows the user an alternate 
method of modifying data for direct input to the TPF model. Finally, this 
interface exists in its present configuration as this is the planned "port" for 
direct conmuni cation with the model through a terminal conmunl cation system. 
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The statist'ca"! d<ita yathered in this exercise consists of two data sets, the 
longest containinn over 27,000 physical records of 40 data elements each. 
This collection data his been te^^d the statistical data base and is 
explained fully in Volume III, Section IV, under Statistical Data. As these 
statistical data are rerined, it is anticlpateu this data base will be utilized 
on line. 

LOGIC DESIGN 

In general, the design of the TPF model is such that it might be termed a 
front-end Iqa-Jed iiKdel. That is, all schedule and demand conditions for a course 
are loaded at the b'.ginnincj or the year, and the model then projects the re- 
sultant con:^it1ons for the remaindar of the year. Likewise, the basic model 
project*;, rather than predicts. That is, the model itself is a true simulation, 
or mathamatic?il reprcseni^tioh of the mechanics of the overall scheduling func 
tion for tho Center. All . •!.;oj funutionr, that affect student flow are modeled 
to a detail -Imllar U. the ictual operations at the Center, which include quota 
control, DUPERS doldHing, scheduling, failures, and setbacks. The model out- 
puts, however, can be predi«:ti'/e if thi inputs themselves are predictive. To 
uso the nodul for d«cijion miking purposes, the user must input his predictions 
of demands, schedule uhanc,-;s, new courses, etc., and the model then projects 
the annual throughputs, fcflure-i, AOB's, and such, based on these predictions. 
Likewise, a simulatioi model 1s not an optimization model; the large number of 
variable Input paramoters precludes tliis. The user can manipulate the model 
Inputs to achit>ve optimal r^ssults. 

PROGRAM LOGIC DESIGN. Tne TPF riR^del consists of a main control program and six 
subroutines, all coded ^n the FORTRAiN language. This structure was chosen for 
several reasons. Al" input ilaU enter through the main control program, which 
edits cue InpuL dat-; ind bui cls a matrix for communication between the sub- 
routines, Thv.si, if i' Jt ri'iti '>ds should be changed, such as entering backlog 
as stu'lent*> r.tb.ar Uv\\ Lhe CTesent method of entering weeks, only one routine 
would require a minor ciK.ngt. cnJ no revalidation of the other subroutines 
wou^d be roquir'id. A<5 ano 'hsr example, the entire scheduling routine is con- 
tained in iubroutir-i CKSRLS. This subroutine represents the methods and pro- 
cedures cu.Tently in i, e a*. Ine Center. Should it be desirable to represent 
other centers witli difiarent methods and procedures, a new subroutine to repre- 
sent th£t center cou>' oe w 'itten, and the appropriate subroutine could be 
linked to tiie uione] ^ ox'^jute tiiiie. In summary, the model has been written in 
a modui' r fOui ' o as a allow adaptability and ease of modification without 
extensi ve vewr. t«?. 

One final Uzi.<v wa» paramou.it to the design of the model, that of execution 
speed. Dthar larjjages, such ?s D^n?mo and GPSS, could have been adapted to 
the problem at hand. However, each of these is a general simulation, and 
compromises would have been required in a model of this size. Probably the 
greatest compromise would have been in execution time. The TPF model currently 
requires 3.6 minuLes elapsed time for an annual process of all 125 courses pres- 
ently active at the Fleet Training Center, and to print the 5A page summary 
report. This execution speed is due in part to the fact that all model run data 
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are stored in a matrix that is core resident, with no disk access required. Also, 
special attention has been paid to real-time programminq techniques, such as the 
use of the "arithmetical if" rather than the "logical if", the latter being more 
convenient to use but substantially slower in execution. 

Program - MAIN. The program MAIN is the control portion of the model. The first 
consideration in the design of this program was that it was to be the primary 
Interface with the outside world. All Input data and control inputs enter 
through this program. One requirement placed upon this program was that the 
model should execute even if an invalid parameter is specified on an input card. 
Nothing is more discouraging than sending a job to the computer center, waiting 
two days for the turnaround, and then finding that the job was not run because 
of a keypunch error on an Input card. Because of this, over 50 percent of the 
program MAIN Is spent in editing Input data. An example of the logic used for 
data error detection and correction can be found in the entry for years of the 
run*. The feature of entering years of the run Is somewhat cosmetic In nature, as 
these figures are not used for Input calculations, but are printed on the output 
report to Identify the years of the run. The number of years of the run (or 
model yearly cycles) Is determined by subtracting the first year from the last 
year; 1f the result is negative the result Is made positive and the years inter- 
changed. If only one year input is present, the model will run only one year; if 
no years are present, the model will default to 1975 and run for one year; if the 
years of the run are greater than three, the run will be clamped to three years. Most 
other data elements go through some sort of error checking, especially tests for 
Invalid, negative, out-of-ranga, or logically Invalid conditions. The data 
elements found in error are zeroed or clamped at some value, an error or warning 
message printed, and processing continues. 

The program MAIN also sets the run condition flags for communication with the 
subroutines. Nearly all of this communication is through the use of FORTRAN 
common, rather than subroutine parameter passing. This is to aid documentation 
and assure ease of modification. The name PASS In one subroutine means the same 
thing as the name PASS in any other. subroutine, reducing the need for redefini- 
tion within each subroutine. 

Except for one routine, the rest of the MAIN program logic is straightforward, 
using standard FORTRAN coding techniques. Three major cycling paths exist in 
the model; the year loop, the quarter loop, and the week loop. One of these, 
the quarter loop, can undergo alteration to initialize the model. The TPF 
model does not snapshot existing conditions, but rather it views conditions over 
a period of time. It considers the schedule and classes as they are today, and 
projects for one year. One Important factor must be recognized. There may be 
70 courses In session that were started in a preceding period and which, because 
of their length, terminate In the first quarter being projected. To represent 
this, the quarter loop can reconfigure and, for the initialization phase, the 
model operates as though it were the quarter prior to model start. No totals are 
accumulated for the run; the only effect is to release courses so that they may 
be active at model start. Subroutine PRERUN is used to accomplish this, and this 
initialization will be discussed in further detail in that segment. This initia- 
lization is Important to properly calculate AOB and establish Initial student flow. 
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The lowest order cycling loop in the model is the week loop. This loop first 
scans each course loaded in the model, one at a time, for a course that should 
convene that week. It does this by testing the convening frequency of the 
course against a matrix loaded in core, for convening frequencies of 1 to 50 
convenings per year. Before this comparison Is made, the matrix is rationalized 
for offset, change week, and multiple convenings. This routine is described 
linnediately following this segment, but for now, all that is necessary to know 
Is that if this matrix returns a code that the course should start, subroutine 
PRERUN will be called and the course started. When a course is started, it is 
placed In an active matrix, which is described in the subroutine PRERUN segment. 
Upon completion of the test for possible convening of all courses, the MAIN pro- . 
gram then tests all active courses to see if any end in that week. As the model ^ 
cycles on a weekly basis, many courses will begin and end in the same weekly loop. 
When a course is found to end, subroutine CRSEND is called which closes out the 
course, allocates the AOB, and calculates attrition. When all of the 300 possible 
active courses have been tested, the weekly loop recycles to run another week. 

Every 13 weeks the quarter loop cycles, calling subroutine QRTEND, to allocate 
AOB against quarters and accumulate totals. Finally, after 4 quarters, the year 
loop cycles, calling subroutine YEARND* which controls printout for the yearly 
report. 

Scheduling Algorithm . Several scheduling algorithms were studied as candidates 
for this model, une of the most common schemes uses a calendar and requires 
some form of Input date for each convening. This is suitable for a simulation 
of construction projects or other projects with few convenings and absolute 
accuracy requirements. However, it is not usable when there is the possibility 
that a Fleet course may have over 400 convenings per year. Thus, an accurate 
but efficient routine was needed. As part of the design efforts the actual con- 
vening dates for many of the courses were plotted. These plots were then 
analyzed and an allowance was made for conmon holidays. The data were then 
transferred to the matrix shown in Figure IV-5. This shows the scheduled con- 
vening weeks for courses with a convening frequency of 1 to 50 per year. Many 
courses convened more frequently than this, and these ere handled by breaking 
them into multiple courses, each with convening frequencies of less than 50, 
but whose overall convenings are the same as the original. For example, a course 
with 51 annual convenings is handled as two courses, one that convenes 26 times 
annually, and one that convenes 25 times annually. Using this technique, the 
TPF model can handle courses with up to 500 annual convenings. The convening 
matrix Itself is stored in core and named ISCHED, with data loaded in hexidecimal • 
format - FORTRAN allows the loading of hexidecimal data, but does not allow indi- 
vidual bit testing or manipulating. Therefore, a synthetic method of bit testing 
was developed. This technique involves extracting the proper bit pattern by divi- 
sion by various constants based on week and quarter, which leaves a 1 in the low 
order bit position if the course is to start, or 0 if it should not. This extracted 
bit pattern Is then tested to determine whether the low order bit is a 0 or 1, 
which Is accontpllshed by a division by integer 2, and then a multiplication by 
Integer 2. If the result is the same as the original, the low order bit was 0 
and the course Is not released. Two rationalizations must be made prior to look- 
up In this table. First, if a course convenes only once a year, the matrix will 
start It the first week of the model run. In reality, this course may convene 
on the 21st week. Offset was Introduced as an input to the model to allow fine 
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tuning of the course release date. An offset of 20, for example, will tell the 
model to enter the schedule matrix as week 1 when the model is in the 21st week. 
This is useful to assure that student AOB is allocated to the proper quarter. 
The second parameter that may modify the schedule algorithm is "change week". 
This parameter allows a course to run for part of a year under one set of con- 
ditions, and the remainder of the year under a second set of conditions. 

As this technique uses matrix lookup, the table must be protected for invalid 
entries while preserving flexibility. If the convening frequency is 0, the 
matrix will be bypassed and the course is not run. If the week is greater than 
52, 52 is subtracted from the week until it is less than 52. If offset is 
positive, such as 21, no courses will be released until the 22nd week, regard- 
less of the convening frequency. On the other hand, a negative offset of 31 
would accomplish the same schedule shift, and courses could be released from the 
start of the model run. 

Subroutine CRSRLS. The course release subroutine contains the scheduling logic 
for the center. This includes keeping backlog counts, scheduling only local 
seats, and overbooking certain courses with high no-show rates. The logic of 
this subroutine schedules the BUPERS students based on the annual BUPERS plan, 
divided by current convening frequency. This Is done even if the result 
exceeds the seats controlled by BUPERS. Next, Iocp.1 quotas are released. This 
Is accornpllshed by releasing students to a backlog pool based on local demand, 
divided by current convenings. This pool is released to the course up to the 
local capacity* No-shows are then calculated using historical no-show percentages. 
Only local students are used for this calculation as BUPERS students generally are 
on TAD or PCS orders, and are not identifiable as no-shows. Finally, for courses 
running near capacity, up to 10 percent of the capacity is released from the 
backlog pool as substitute quotas. This routine then builds an entry in the 
course active matrix. Included is utilization, weeks till termination, and a 
term to allocate AOB between quarters and between classes if a student should 
be set back. This subroutine closely represents the scheduling methods in use 
at the Center. If other centers, with different algorithms, should be studied, 
this subroutine would most likely be replaced by one representing the location 
under study. 

Subroutine forerun . As mentioned previously, the model can run in an Initial iza- 
tlon mode for one quarter prior to the actual model run. Subroutine PRERUN is 
called by CRSRLS any time the model is in the Initialization mode. It is re- 
quired for two functions. First, courses are tested prior to release to ascertain 
whether they should be running at model start or not at all. Second, this sub- 
routine allocates AOB for those courses to assure that AOB applicable' to the 
first quarter is charged to the first quarter. 

Subroutine CRSENO. This subroutine is called any time a course is found to end. 
Three functions are performed by this subroutine, closing out the active course, 
disposing of the students, and allocating AOB. The first function merely consists 
of deleting all reference to the course from the active matrix. Disposing of 
the students is more difficult. Failures are calculated first, using the 
current failure rate. This is either the historical rate or a revised failure 
rate, calculated by the statistical update program. Whichever failure rate is se- 
lected, it is constant for the model run. Two avenues for further study have been 
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apparent during the design of this model. First, it Is believed that the 
Interface with the statistical data could be made dynamic, giving individual 
classes individual characteristfcs. Second, no provision is made to show, 
reduction in AOB due to a failure dropping out of a course prior to Us com- 
pletion. There are two reasons for this latter condition. First, the dropout 
rates have a relevance to the job the student is to perform. In the case of a 
supply clerk, he may complete the course even though he is an obvious failure, 
because despite the failure, he will be doing the job. Second, over 85 per- 
cent of the failures are from courses one week or shorter where the early termi- 
nation Is Insignificant. 

The second student category calculated is non-academic disenrollments. Again, 
these students are calculated from static percentages, and as no data were yet 
available, no reduction was made to AOB. 

The last student category is setbacks. Setback logic currently allows setbacks 
for those courses three weeks or longer, and where more than one convening is in 
session at a time. This setback rate Is currently based on a fixed percentage 
of failures per class. AG3 for setback Is allocated between the "entered In 
and "finished In" convening. Finally, this subroutine calculates AOB based on 
the current calculation method In effect. 

Subroutine QTRE ND. This short subroutine Is used to accurately allocate AOB 
between quarters. Only the active courses are tested at the end of a quarter, 
the accumulated AOB Is charged to the current quarter, and the active course 
AOB Is adjusted accordingly. 

Subroutine YEARND . This subroutine is used to print a short form printout of 
nuarterly model data. This printout can be called by a Trace flag on the para- 
meter card. If this Trace flag Is not ON, subroutine NPRINT Is called. 

Subroutine NPRINT . This subroutine accumulates annua! data, prints the annual 
course, scnooi, and Center quarterly reports, and restores the model for execu- 
tion In multiple years. A sample of the course formats Is shown In Figure 
IV-2 while a sample of the school and Center formats Is shown In Figure IV-6. 

LEVEL 1 VALIDATION SCENARIOS 

The TPF model is a simulation program representing the physical operation 
of the Fleet Training Center, Norfolk, Virginia, and is written in the FORTRAN 
language. Unlike the other models discussed in this report, the TPF model uses 
no predeveloped programs as part of the simulation. Thus, the entire mechanics 
of the model required validation, along with the validation of the simulation 
algorithm. 

MODEL ARITHMETICAL VALIDATION. The first step 1n validating the TPF model was 
to exercise the model In all possible modes. The first run consisted of running 
the'models with course convenings of 1 to 200, and then verifying that the 
proper nunfcer of convenings occurred. Next, the lengths were varied, and one 
student placed In each convening to verify the AOB calculations. The offset 
was validated for both positive and negative values of up to one year. Each of 
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the other algorithms, such as those for SUPERS control, no-shows, substitute 
quotas, dropouts, setbacks, etc., were exercised one at a time and in combina- 
tions to verify that the desired results were obtained. The listings for 
these validations are lengUiy, however, and are not included as part of this 
report. 

VALIDATION SCENARIOS. General validation runs were executed utilizing the TPF 
model to verify the utility of this model as a tool for evaluating change. 
Four of these runs are presented here. 

Excessiv e No - Shov^ Rales . The course. Boiler Feedwater and Test, was used as an 
example to snow the utility of the model 1n evaluating the real cost of no-shows. 
The data used In this example are not current since this course has been totally 
restructured. The prior data, however, are useful for this example. In this 
hypothetical example, the course was operating with a bacldog of about 20 weeks, 
but was running at only aLrut 80 percent capacity because of a high no-show rate. 

The TPF model was executed to show the improvement that could be expected by 
cutting the current no-show rate by ?5 percent and 50 percent. The results of this 
experiment are shown in Mgure IV-7. The top portion of this figure Illustrates 
the results obtained by executing the model with all course data drawn directly 
from the data base, so as to show quarterly and annual predictions for the course 
under existinq conditions. The center portion shows the results with the no-show 
rate cut to 18.3 percent, while the bottom portion shows the results with the no- 
show rate cut to 12.1 percent. All other parameters were held constant. Under 
existing conditions, it Is projected that 618 students will utilize the course 
annually, with the reduced no-show rates Improving this utilization to 667 in the 
second case, and to 717 with the no-show rate cut to 12.1 percent (50 percent of 
the original rate). 

It was then oeclded to establish the number of additional convenings necessary to 
achieve the MaUur utilization if the no-show rate could not be reduced. The 
convenings were increased in increments of 4 until the desired utilization was 
obtained. The results of this experiment can be seen in Figure IV-8. Again, 
In the top portion of this figure, the model was executed under existing conditions 
to establish the baseline. In the center portion, the convening frequency was 
Increased by 4 to 52. and in the bottom portion it was again increased by 4 to 56 
annual convenings. The bottom portion gives a projected utilization of 720, which • 
Is close to the 717 utilization obtained by reducing the no-show rate by 50 percent. 
Thus, it can be predicted that the cost of just half of these no-shows, in terms 
of resource Impact, is 8 convenings per year. 

Variation 1n Student CiiarQcter 1st1c_s . In this example, it was desired to observe 
the varUtion'Th"'"the throu^gHput that might be expected if the average of certain 
student characteristics were varied by plus and minus 5 percent. The course 
chosen for study was Air Conditioning and Refrigeration. The student character- 
istics varied were the average 6CT and ARI test scores. 

This example required a two part solution. The first Portion of this can be 
seen in Figure IV-9. This figure shows this course (number 4552) with the failure 
rate calculated on the left, the GCT and ARI scores increased by 5 percent in the 



IV-24 



TAEG REPORT NO. 12-2 



center using existing averages, and on the right with the GCT and ARI scores 
decreased by 5 percent. The programs used 1n this example were the off-line 
FAILl, FAIL2, and FAIL3. These programs predicted that the failure rate would 
decrease to 7.9 percent with a 5 percent increase of the test scores (as compared 
to ati existing failure rate of 11.6 percent), and would increase to 15.3 percent 
with a decrease in test scores of 5 percent. 

These new failure rates were Introduced as Inputs to the TPF model to establish 
the corresponding throughputs. The results of this experiment may be seen in 
Figure IV-10. All other input parameters were held constant. In the top example, 
the lower failure rate was used, giving a throughput of 325 passing students.. The 
center example used the existing failure rate, predicting a throughput of 309 
passing students, while the bottom example, using the higher failure rate, resulted 
in 293 passing students. Thus, it can be predicted that a change of 3 percent in 
. test scores will modify the failure rate by approximately 3.7 percent, resulting 
In a change of about 16 passing students annually under current conditions. 

Backlog Reduction. This example Illustrates how the TPF model can be used to 
evaluate course changes required by temporary Imparts. It is assumed that the 
course. Introduction to 3-M, has been Impacted as a result of an extremely large 
number of students requesting the course due to precommissioning activities, re- 
sulting in a current backlog of 10 weeks, or over 1400 students. It has been 
decided to Iwnedlately Increase the convening frequency to 4 per week (176 annually) 
to work off this backlog. However, the peak demand is assumed to be temporary, 
and the demand figures from the original plan are believed to be valid. 

The TPF model was used to establish the effects of first, continuing this higher 
convening rate Indefinitely, second, returning to the original schedule in 6 months; 
and finally, retu»T<ng to the original schedule In 3 months. The TPF model results 
may be seen In Figu;? IV-11. The top example shows the results obtained by con- 
tinuing the course Indefinitely at the higher convening frequency, resulting In an 
annual utilization rate of 74.7 percent. In the center example, the convening 
frequencr was cut to 3 per week (132 annually) at the end of 26 weeks. This re- 
sulted 1i* an annual utilization of 85.6 percent, with the backlog totally elimi- 
nated by the end of the second quarter. In the bottom example, the course was 
reduced to Its original convenlna frequency at the end of the J^jst quarter (13 
weeks). This resulted In a ditlllzation rate of 91.3 percent, but still showed 
a 4 week backlog at the end of the second quarter. These figures present some 
of the Insight necessary to choose the pj*oper course of action. 

Align Capacity to Demand . In this example, the TPF model is used to evaluate the 
effects of reducing course convenings In order to bring utilization to a more 
favorable percentage. In the example, the course has been experiencing a utiliza- 
tion rate of less than 50 percent, and it is desired to increase this oy a reduc- 
tion in convenings. However, the situation is clouded somewhat by a relatively 
high no-show rate and a current temporary demand caused by precommissioning 
activities. 

The TPF model was run to test the results of reducing the convening frequency 
Inmedlately to 20 annual convenings and 16 annual convenings. The results of 
this are shown In Figure IV-12. In this figure, the top example shows existing 
conditions as a baseline, indicating an annual utilization rate of only 50.7 per- 
cent. In the second example, the convening frequency is Immediately cut to 20, 
alving an annual utilization rate of 61.2 percent. In the bottom example, the 
convening frequency Is Ininediately cut to 16, resulting in a more favorable 
^ utilization rate of 77.1 perc^nj^ without an excessive wait time (backlog). 
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SECTION V 



MODEL TEST APPLICATIONS SCENARIOS 



CONDITIONS FOR MODEL APPLICATION 

The three DOTS models can only be useful when applied to a training system 
which is changing or which can be changed. If the training system remains 
structurally the same and responds to new demands, either by absorbing them 
in excess system capacity or by refusing to accept new requirements, the models 
are useful only to the extent that their bookkeeping capabilities can be used. 

Demands placed on the system can originate from a variety of sources, but can 
be classified roughly into two categories: quantitative demands and qualita- 
tive demands. Quantitative demands are those which require system output to 
change numerically. The system is required to produce trained personnel of the 
same kind and In the same way as in the past, but the numbers trained in 
different courses are changed. 

Qualitative demands are those which require the system to produce different 
kinds of trained people, or people trained by different methods. Q^alitat ve 
demands can originate external to the system (e.g., new equipment train ng)o 
internal to the system (e.g., introduction of "ew instructional methodology^ 
Regardless of type, qualitative demands require the system to be changed in 
some way other than rearrangement of existing courses and resources. Figure 
V-1 shows the basic response to qualitative and quantitative change. 

PROBABLE APPLICATIONS OF DOTS MODELS 

Before discussing the most probable applications of the DOTS models in differ- 
ent system environments, the basic purpose of each of the three models should be 
re-stated: 

a. SCRR model - determines optimum arrangements of course convenings, 
instructor, and other resources to produce a particular quantita- 
tive system output. 

b. TPF model - given convening schedules and course types, the TPF 
model predicts true system output based on a qualitative descrip- 
tion of the students entering the system. 

c. ETE model - given available resources and course configuration, 
the ETE model predicts course throughput and resource utilization 
when Individualized learning techniques are employed. 

From these model objectives, some general rules concerning model application can 
be inferred. The SCRR and TPF models complement eacht other and will be equally 
applicable to a particular problem. The only exception to this is that the TPF 
model has bookkeeping capabilities useful in producing training system status re- 
ports, and so will find some application regardless of training system operation. 

The ETE model, because it deals specifically with the use of Individualized learn- 
Inq techniques, is less general than the SCRR or TPF models. Also, because 1t can 
function either as a design tool or in monitoring an existing system, the ETE model 
will be applied at different times In the training requirement-to-implementation 
cycle than the other models. 
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TYPE OF CHANGE 


PROBABLE TRAINING SYSTEM RESPONSE 


QUANTITATIVE CHANGE 


• REVAMP COURSE SCHEDULES, INCREASE CONVENING 
FREQUENCIES AND CAPACITIES FOR SOME COURSES. 
DECREASE OTHERS. 


QUALITATIVE CHANGE 


• DESIGN AND IMPLEMENT NEW COURSES, ADJUST 
SYSTEM RESOURCES TO ACCOMMODATE. 

• REDESIGN EXISTING COURSES TO APPLY DIFFERENT 
. INSTRUCTIONAL METHODS. 

• RESTRUCTURE SYSTEM. COMBINE COURSES, SHIFT 
EMPHASIS, MOVE TRAINING TO SHIPBOARD OR 
VICE VERSA. 



FIGURE V-1 TRAINING SYSTEM RESPONSES TO GENERAL DEMANDS 



Figure V-2 shows the probable level of application of each of the three models 
In response to seven different system demand-response combinations. Four of 
these combinations, and the corresponding application of the three models, will 
be discussed in the following scenarios. The demand-response combinations to 
be discussed are: 

System As Is. Study to improve operation, but ho change in instruc- 
tion methods. 



a. 



b. 



c. 



d. 



Course Offerings Unchanged But Move to ILS Methods. 
New Equipment Requires New Courses. 
NEOCS Type Structural Change. 



STUDY TO IMPROVE EXISTING SYSTEM, 
not appHcabTe in this sTEiatTon. 
Is so low at the present time. 



As Figure V-2 indicates, the ETE model ii 
This is because the number of ILS courses 



The first step in applying the models to this type of study is to determine 
possible strategies for improving system throughput without increasing system 
resources. Next, each of these strategies is reviewed to determine the degree 
to which it can be carried out. Because the strategies can be tested without 
disturbing the real system, it is reasonable to postulate both an ideal situa- 
tion, in which the strategy can be stated without regard to real world con- 
straints, and other "most likely" situations, in which the analyst attempts 
to include krown conditions in estimating how far a strategy can reasonably 
be carried. ^ 
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Each of these strategies is then tested using the SCRR model and the TPF modci. 
The analyst iien dotennines the best combination of foasibility and benefit 
and trans! atto these results into recommendations for chanqe within the system, 
or into requests for change in operations external to the system. 

Figure V-3 is a detailed flow of the use of this method for a training system 
such as FLETP;\r,EN. NORVA. For purposes of this illustration, it was assumed 
that the first resource to be studied was the instructor staff. The first 
strategy listed represents an ideal situation "in which all instructors can 
teach all courses, so that an optimum class schedule can be derived without 
being constrained by the availability of a particular type of instructor. The 
second strategy is a "most likely" case of the instructor pooling strategy, 
and the third is a different strategy for providing limited instructor pooling. 

IMPLEMENTATION OF H.S METHODS. Unlike the previous example, the strategy here 
is known; i.e.. to implement ILS techniques for a set of existing courses. The 
ETE model would come into play at two different stages in this situation. 
First, it would be Jseti to derive the desired ILS course configurations and to 
assess the resources required to support the courses converted to ILS. 

Second, with these desired ILS course specifications as the starting point, it 
would be used to assess the impact on the training system of these ILS courses, 
and assure that the system v/ill perform satisfactorily and that the resources 
exist to support ILS operation. 

The steps In this sequence are illustrated in Figure V-4. Each feedback loop 
shown can represent several iterations of the process. The SCRR and TPF models, 
again, act in complementary fashion, with the SCRR model determining optimum 
resource allocation and the TPF model testing system throughput. 

NEW EQUIPMENT REQUIRING NEW COURSES. Figure V-2 shows this situation providing 
only a moderate level of use for the three models. The moderate usage level 
is projected based on the assumption that only a limited number of new courses 
will result fmm the introduction of a single new piece of equipment. The 
introduction of one or two courses could be accomplished without the aid of the 
models. , 

The primary purpose of this scenario is to show the time differential in model 
application for certain kinds of courses. Where courses deal with specific 
pieces of equipment, it is usually not practical to employ ILS techniques early 
in the life of the (jquipmenL, when frequent engineering changes are being made. 
For this scenario, it is assumed that the original course material is supplied, 
in conventional classroom form, by the equipment vendor. 

Figure V-5 shows the timeline applicaticn of the models. When the ILS version 
of these equipment courses is developed, the steps followed will be the same as 
those described in the previous scenario. 

NEOCS TYPE STRUCTURAL CHANGE. Some of the recommendations contained in the 
Naval Enlisted Occupational Classification Study (NEOCS) cflujd result in ma^lor 
changes to the structure and role of training systems such as FLETRACEN nokvm. i 
is impractical, lacking information on the strategies to be used in accomplish- 
ing the goals set forth in the NEOCS report, to attempt to define all the ways 
In which the DOTS models could be applied to so fundamental a restructuring of 
the training system. A single objective and its implications will be considered 
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here. Table V-1 lists some of the implications of the NEOCS objective to oost- 

tJ^fnin^'^'^n??^ requirement for increased fleet and t^pe 

IZlnint^ Tnl5.'f'^"^' an nxce lent candidate for individualized instructional 
fr^fn 2n L .li" ^^?^' Sign ficant portion of any increase in fleet and type 

tivp^n™??!;.!*'!' scenario, it is assumed that COWTRALANT/PAC and their respec- 
ting J^fl^nn"!' S'^® been tasked w th the establishment and control of fleet/ 
FuS?hlr ^°c^' ''S"?!^'!®^ ^^'^oard and at the training centers, 

and Jrl^cJLlhif hT"^ ^^^b f^"^. Possible, this training will be individualized 
and transferable between shipboard, and the FLETRACEN. 
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POSTPONE HEAVY TECHNICAL TRAINING 

t CHANGE IN PROFILE OF STUDENTS ENTERING "C" SCHOOL AND 
ESTABLISHMENT OF "E" SCHOOLS 

• INCREASED EMPHASIS ON OBT FOR FIRST TOUR 

INCREASED FLEET AND TYPE TRAINING 

• SOME COULD BE CARRIED OUT ON BOARD 

• • INCREASED LOAD ON FLETRACEN'S FOR NEW, GENERAL COURSES 



TABLE V-1 IMPLICATIONS OF PROPOSED CHANGES IN TRAINING OCCURRENCES 
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